Hero union is awesome. others are more relaxing stuff but I laugh lots: chichi to ko nozaki-kun oresama teacher please look foward to the next death game (?)(title unsure)
It probably ain’t similar, but it has comedy. There Are Too Many Truck Reincarnations! 〜The Truck Drivers Are Crying〜 Megami Buchigire
I'm not sure what part of konosuba you liked, so I'll just list my favorite comedy manga: angel densetsu great teacher onizuka sakamoto desu ga azumanga daioh barakamon ocha nigosu Watashi ga Motenai no wa Dō Kangaetemo Omaera ga Warui yotsubato zai x 10 sket dance (most people consider gintama better, but I personally didn't get into it) spy x family komi-san wa komyushou desu saiki kusuo sayonara zetsubou sensei tonari no seki-kun working black general d-frag li orc no hi fujimura mates cromartie high school has a little drama later, but is pure comedy for most of it: assassination classroom kaguya sama wants to be confessed to ouran host club yandere kanojo tsuredure children jitsu wa watashi wa
comedy is my favorite genre (I've read 1000s of comedy manga/manhwa) so I did try to pick the best ones that are closer to 'pure comedy'. I also like comedy in some more serious works like: golden kamui, and dungeon meshi, but I don't think they're really 'pure comedy' some more: ultimate rock-paper-scissors sheriff evan's lies hayate no gotoku onepunch-man Gokushufudou: The Way of the House Husband hinamatsuri 4-cut hero (webtoon is on hiatus though) zippy ziggy 100 Things I Want to do Before I Become a Zombie the world god only knows school rumble
Depends on what sort of comedies you're looking for: Gokushufudou Maoujou de Oyasumi Okusan High School Inari Tamamo-chan Tomo-chan wa Onnanoko (+) Komi-san wa Komyushou Desu Wotakoi Gekkan Shoujo Nozaki-kun Youjo Senki, Drifters, Hellsing, Jormungand & Black Lagoon for those looking for dark comedies