sounds like something being tossed around.... that does not sound like a throw out bearing. the throw out bearing sounds more like a rubbing.... it ought to be ok to drive back.... i'd have someone in another car come with just in case. I've driven a stupid amount on cars with tranny issues.
it sounds more like bearings to me.... you'll probably have to double clutch when/if it gets worse.... good luck