I commuted for about a year before switching back to gears. I switched back to gears because i was regularly towing my kids in a trailer and that was too much work.
I love single speeds. I would just do whichever you think will bring you more joy. The difference in time will probably be a couple minutes, which really isn’t a big deal.
I’m currently building up a singlespeed cyclocross bike and I’m really excited about it. Keep us posted on this!