I have found a work around - there is an app called Invitation Plugin. It allows you to open the invite.ics from gmail and view the event directly in Calendar.
It's a work around for a problem that didn't exist in Ice Cream Sandwich but now does exist in Jelly Bean and really shouldn't exist at all but at least it's a simple and effective work around.