What System Configuration and postgres Configuration Is Needed to Handle 5000 pgRouting Requests at the same time?
0
votes
0
answers
25
views
`I’m working on a project where we need to process 5000 concurrent pgRouting requests involving PostgreSQL with the pgRouting extension. The requests will mainly involve route planning and shortest path calculations over a large graph. We need to ensure the system can handle high traffic and provide low-latency responses. System Overview:
Database: PostgreSQL 12 with pgRouting and postgis
Graph Size: around 2 millions
Request Type: Each request will perform routing queries (shortest path, multi-stop, etc.) on the graph.
Concurrency: Expected to handle 5000 concurrent pgRouting requests.
We’re currently considering the following system configuration:
CPU: 8 core
RAM: 64 GB
Key Questions:
PostgreSQL Configuration: What are the best PostgreSQL settings to optimize for high concurrency and pgRouting queries? Specifically, we are looking for recommendations on:
these are my current settings :
max_connections = 5000
shared_buffers = 16GB
effective_cache_size = 48GB
maintenance_work_mem = 2047MB
checkpoint_completion_target = 0.9
wal_buffers = 16MB
default_statistics_target = 100
random_page_cost = 4
work_mem = 419kB
huge_pages = try
min_wal_size = 1GB
max_wal_size = 4GB
max_worker_processes = 8
max_parallel_workers_per_gather = 4
max_parallel_workers = 8
max_parallel_maintenance_workers = 4
Connection Pooling: Should we use connection pooling (e.g., PgBouncer) to manage database connections? If so, what is the recommended pool size and pool mode?
Query Optimization: Are there specific pgRouting query optimizations (e.g., caching query results, query structure, or parameterization) that we should implement to improve the response time for routing queries?
Any recommendations on:
Hardware Setup: CPU, RAM, storage options for optimal PostgreSQL and pgRouting performance.
Database Settings: PostgreSQL configuration tips to handle 5000 concurrent requests with low latency and high throughput.
pgRouting Tuning: pgRouting-specific optimizations for large-scale routing.
Asked by bhargav_seladiya
(1 rep)
Nov 12, 2024, 10:14 AM