40 million requests per second: Pingora - a new high-performance framework based on Rust

Teacher

Professional
Messages
2,669
Reaction score
819
Points
113
Cloudflare shares open source for a reliable and uninterrupted Internet experience.

Cloudflare announced the release of Pingora, a Rust-based framework that is already used in Cloudflare's mission-critical systems, processing more than 40 million requests per second. Pingora is available under the Apache license version 2.0 and is an asynchronous multithreaded system for creating HTTP proxy services.

Pingora supports not only proxies, but also clients and servers, and contains utilities for event counting, error handling, and caching. The framework offers libraries and APIs for working with HTTP / 1 and HTTP / 2, TLS and TCP / UDP, supports gRPC and WebSocket, and provides customizable load balancing and fault tolerance strategies.

Among the advantages of Pingora — security and high performance, which makes it an alternative for services written in C / C++. The framework offers advanced customization capabilities through its software-driven API, allowing you to create custom and advanced gateways and load balancers.

An example of using Pingora is to create a simple load balancer that selects between two servers in round-robin mode. The framework provides zero downtime during restarts, supports smooth processing of incoming requests, and easily integrates with monitoring tools such as Syslog, Prometheus, and Sentry.

Cloudflare emphasizes that Pingora is a library and toolset, not an executable file, which makes it a flexible solution for the industry. At the same time, support for non-Unix-like operating systems is not yet included in the development plans.

To contribute to the project, you can send bug reports, documentation questions, or requests for new features in the project's GitHub tracker. It is recommended that you read the participant guide.

Cloudflare also hopes that Pingora will benefit both web service professionals and network technology researchers, emphasizing the importance of moving towards a secure internet and thanking the Rust community for supporting the creation of Pingora.
 
Top