A full rewrite that uses MVT tiles generated by new scripts #11

Open
skylarmt wants to merge 6 commits from Sophox/master into master
Owner

Author: @nyurik

This rewrite makes the whole tile generation done by the openmaptiles SQL scripts,
without doing any funky local math, or strange SQL manipulations.

  • SQL is generated by the new generate-sqltomvt scripts
    (part of the openmaptiles-tools, uses prepared statement variant)
  • Simple to run with docker
  • Proper CLI documentation
  • Simplified PostgreSQL access

Do not merge this PR until https://github.com/openmaptiles/openmaptiles-tools/pull/34 is merged.

TODO: (will be done as separate PRs)

  • write a new tools script to generate a tilejson-spec JSON file from layers
  • Use the result of that script to turn postserve into a full blown tile server, so it can be used directly by the maputnik editor
Author: @nyurik This rewrite makes the whole tile generation done by the openmaptiles SQL scripts, without doing any funky local math, or strange SQL manipulations. * SQL is generated by the new `generate-sqltomvt` scripts (part of the `openmaptiles-tools`, uses prepared statement variant) * Simple to run with docker * Proper CLI documentation * Simplified PostgreSQL access Do not merge this PR until https://github.com/openmaptiles/openmaptiles-tools/pull/34 is merged. TODO: (will be done as separate PRs) * write a new tools script to generate a [tilejson-spec](https://github.com/mapbox/tilejson-spec/tree/master/2.2.0) JSON file from layers * Use the result of that script to turn postserve into a full blown tile server, so it can be used directly by the maputnik editor
Author
Owner

Author: @smellman

I just research about folowing problem.

curl http://localhost:8090/tiles/0/0/0.pbf
curl http://localhost:8090/tiles/0/0/0.pbf
curl http://localhost:8090/tiles/0/0/0.pbf
curl http://localhost:8090/tiles/0/0/0.pbf
curl http://localhost:8090/tiles/0/0/0.pbf
curl http://localhost:8090/tiles/0/0/0.pbf # too slow

Your PRs solve this problem with postgis 2.5.1 & postgresql 11?

Author: @smellman I just research about folowing problem. ``` curl http://localhost:8090/tiles/0/0/0.pbf curl http://localhost:8090/tiles/0/0/0.pbf curl http://localhost:8090/tiles/0/0/0.pbf curl http://localhost:8090/tiles/0/0/0.pbf curl http://localhost:8090/tiles/0/0/0.pbf curl http://localhost:8090/tiles/0/0/0.pbf # too slow ``` Your PRs solve this problem with postgis 2.5.1 & postgresql 11?
Author
Owner

Author: @nyurik

@smellman generating 0/0/0 is always very slow - in some cases it could be a few minutes. My PR does not change the queries or the underlying data. It simply moves all of the MVT PBF generation logic to Postgres, without the need to use Mapnik or any other MVT processing software. The postserve update simplifies usage of those queries. P.S. I posted a link to the OMT slack channel -- come discuss it there.

Author: @nyurik @smellman generating 0/0/0 is always very slow - in some cases it could be a few minutes. My PR does not change the queries or the underlying data. It simply moves all of the MVT PBF generation logic to Postgres, without the need to use Mapnik or any other MVT processing software. The postserve update simplifies usage of those queries. P.S. I posted a link to the OMT [slack channel](https://github.com/openmaptiles/openmaptiles#openmaptiles-) -- come discuss it there.
This pull request has changes conflicting with the target branch.
  • server.py
  • Dockerfile
  • requirements.txt

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin Sophox/master:Sophox/master
git checkout Sophox/master
Sign in to join this conversation.
No Reviewers
No Milestone
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: skylarmt/postserve#11
No description provided.