hi
mellowyellow said it already: to modify (or create) icc-Profiles you will need special software, that is not cheap, look at basiccolor or printopen (Heidelberg) or others
Your Epson Printer i guess has more colours than only CMYK (=just 4 channels)?
What kind of custom ICC-profile do you have (4-channel CMYK?) and where is it placed on your workstation?
If you have a 4-channel custom profile, so what about a convertion from your photoshop CMYK-workingspace-profile into your custom-profile, i guess they are different...
(go to the menu third from the left and then third from bottom: "Change profile into" or somthing in that sense - sorry my Menu is in german language...), i would prefer Rendering Intent relativ colorimetric with blackpoint compensation by nearby gamuts, don´t use saturation or absolute, maybe perceptiv is better..)
I do not know, but i guess your 8- or 11-Channel Epson large Format-profile is in the maschine and the incoming CMYK-values (or do you send rgb?) will be converted there.
Another approach:
If you had build up your own customer icc-profiles with a target-file, try to modify a copy of it in your sense with graduation(?)-curves imn the direction you will go for...
May be this all is without sense for you, but we need more information about your aims and arms ;-)
Ulrich