Hi !
I think you can use my code to detect and extract the grid, then run a "color detector" script on all the regions instead of the Tesseract recognizer, and return the RBG/HSL/... values in a text file.
I don't know if the region's pre-processing (denoizing, clear border, ...) will be useful though.
For the color detection, I found this tutorial : https://www.pyimagesearch.com/2014/08/04/opencv-python-color... which comes from Adrian Rosebrock (https://github.com/jrosebr1) who makes very great Python tutorials.
Hope it'll work !