In a bowl whisk together one flavor gelatin with ¾ C boiling water. Add ice cubes to ½ C cold water, to create 1 ¼ C water. Stir into gelatin mixture until ice is dissolved.
Evenly distribute the gelatin into plastic cups. Place in refrigerator until mostly set, about 20 minutes.
Repeat process with each color, pour each new color onto the previous, creating a layering effect.
Once all the layers are set, refrigerate until serving.
Top with whipped topping if desired.
Optional: Add 2-3 mini marshmallows to into the gelatin mixtures.