It's easy to compress the flash file into something under a megabyte. Your flash file looks as if it's heavily unoptimized. The loading time is a bit slow partially because of that, coupled with the loading of the flash runtimes. 6 megabytes(approximately the download site of your site) is way too huge for people that just want to briefly visit your site for a second or two. I thought that my cable internet went down when I didn't see the website loading(took at least 30 seconds).
I used to like flash because of its glitter, but I started to hate it for casual webbrowsing because it wasn't a click-pop experience. Maybe you could learn advanced javascripting and CSS to make your website functional and light at the same time.
By the way, people hate sound on websites mainly because volume levels sometimes are set at a loud volume. So... what might seem normal might sound like a jet on another's computer. On the other hand, your sounds will just waste bandwidth, space, and time if the person has his volume level either really low or muted.
Personally, I don't think it's too bad of a flash site but you need to consider your target audience. Either compress and/or optimize the whole site so it's at least under a megabyte, reconstruct it with CSS and javascript(still irritating for some), or just use plain html.
