Yes, this is a definite problem! After this weekend’s update to the site, I think the first feature I’m going to work on is showing a list of colors alongside the pattern. It’s highly requested and (hopefully!) solves problems with remembering what colors are which.