What other bugs live in paper nests like bees/wasps?

I found a paper nest hanging from my gutter, but the bugs definitely weren't wasps or bees. I couldn't get close enough to tell what they were because, well, bugs are gross and I didn't want anything flying at me. They were an oblong shape and brown. I couldn't tell if they had wings or not, though when I sprayed the nest with pesticide and went screaming in the other direction, it sounded like maybe they were trying to fly away and escape. Oh, I live about 10 miles south of Baltimore, if that's any help. Any idea what these things were?!?