Gaukurinn

Gaukurinn isn't a gay bar but it's very gay-friendly. They host live bands, karaoke and regular drag shows. Local queer artists perform at Gaukurinn. They also host some comedy shows in English - assuming you aren't fluent in Icelandic!

It's a cool place to hang out. Check their website as the nightly entertainment changes frequently.