Test on Python 3.6 and 3.11 without all intermediate versions.

Also:
- Remove install of `python-pycurl` in GitHub workflow, `pycurl` is installed
  later via tox without having to keep track of Ubuntu package name changes.