Stumbelupon Spike then decline

I posted Votepages on Stumbleupon to get some traffic and have people check it out. On the first day 100 people came to the site which is great ot see. I was very happy with 100 visitors. But then the next day we had none. This is very confusing to me. If the site is listed on Stumbleupon and users can browse it, then why doesnt the level of browsers stay around 100 per day or at least a few per day. Instead it is like there are no visitors. The site does have a couple bugs and does not have tons of content yet, but I would still assume that at least a few Stumbeupon visitors would show up. Its almost like we were banned. Does anyone know why this happens and if there is a cure? Please! :<

Spike and drop in traffic