I’m also -1 on the “quoting keys” suggestion because it breaks consistency. Another place we parse plain keys without quotes is custom template tags.
Adding **kwargs support sounds like the best way forward to me, and best done as a follow up feature.
Edit: another option could be supporting {% querystring mydict %}.