You can customize your store window colors from the Edit Storewindow page (click on the Store tab and then 'Store Window' then 'Edit Store Window')
If you change the colors on that page, then they will be used in all your listings where you put the [STORE_WINDOW] tag.