We never used ours for envelopes although we did buy the feeder.
Your heads are pretty dirty. You could do a strong cleaning cycle but that will only wipe the printhead's surface.
You'll need to get in their with your hand and a cleaning rag. I don't know what you can use for it. Find out from...