Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
A collection of articles on the usage / internal workings of Polars by the core team.https://pola.rs/https://pola.rs/posts/polars-distributed-available-on-kubernetes/https://pola.rs/posts/polars-distributed-available-on-kubernetes/We are launching our distributed engine on Kubernetes (e.g. on-prem, AKS & GKE). Try it for free. It also ships with advanced query profiling and OpenLineage support.Wed, 03 Jun 2026 00:00:00 GMTChiel Petershttps://pola.rs/posts/polars-1-41/https://pola.rs/posts/polars-1-41/Polars 1.41 brings a hand-written Thrift decoder for faster Parquet metadata reads, nested common subplan elimination in the optimizer, and LazyFrame.gather.Tue, 26 May 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/schema-evolution/https://pola.rs/posts/schema-evolution/How Polars handles schema mismatches across CSV schema inference, multi-file Parquet datasets, Delta Lake writes, Apache Iceberg, and when you need to take control manually.Thu, 30 Apr 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/polars-in-aggregate-apr26/https://pola.rs/posts/polars-in-aggregate-apr26/This edition covers the streaming engine's expansion across sinks and joins, new Iceberg and Delta I/O, Polars Cloud query profiling, and the new PartitionBy API.Thu, 16 Apr 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/streaming-joins/https://pola.rs/posts/streaming-joins/Learn how Polars streaming sort-merge join works, the concepts behind the algorithm, and how you can verify the query planner chose the merge-join.Thu, 09 Apr 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/query-profiler-instance-optimization/https://pola.rs/posts/query-profiler-instance-optimization/Introducing the Polars Cloud query profiler. In this post we use it to identify performance bottlenecks and select the right instance family, instance type, and cluster size for your workload.Thu, 26 Mar 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/airflow-orchestration/https://pola.rs/posts/airflow-orchestration/How to schedule and run Polars Cloud queries using Airflow, covering fire-and-forget jobs, parallel execution, multi-stage pipelines, and cluster management.Tue, 17 Feb 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/categoricals-refactor/https://pola.rs/posts/categoricals-refactor/Exploring the evolution of the Categorical data type in Polars.Thu, 29 Jan 2026 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/case-rabobank/https://pola.rs/posts/case-rabobank/Window functions are a perfect fit for detecting periodic payment bookings at Rabobank. They not only improve performance but also makes code easier to read.Wed, 10 Dec 2025 00:00:00 GMTFreerk Venhuizen, Senior Data Scientist @ Rabobankhttps://pola.rs/posts/polars-in-aggregate-dec25/https://pola.rs/posts/polars-in-aggregate-dec25/This edition covers the launch of Polars Cloud, the new streaming engine, the Categoricals overhaul, the stabilization of Decimals, introduction of Int128, and the introduction of runtimes.Wed, 03 Dec 2025 00:00:00 GMTThijs Nieuwdorphttps://pola.rs/posts/case-citizens/https://pola.rs/posts/case-citizens/With Polars, Citizens achieved faster development cycles, richer and more timely insights, and created a strong pillar for the ongoing modernization journey.Wed, 26 Nov 2025 00:00:00 GMTTyler Riccio, Assistant Vice President Enterprise Data and Analytics @ Citizenshttps://pola.rs/posts/case-mobiliere/https://pola.rs/posts/case-mobiliere/La Mobilière always keeps its promise. Now, even more promptly, thanks to Polars.Thu, 09 Oct 2025 00:00:00 GMTDr. Michael Tomka - Actuary @ La Mobilière and Dr. Santiago Padrón - Senior Data and Machine Learning Consultant @ D ONEhttps://pola.rs/posts/series_a/https://pola.rs/posts/series_a/We have raised €18M in Series A funding the build the next generation data.Mon, 29 Sep 2025 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/case-decathlon/https://pola.rs/posts/case-decathlon/Decathlon adopts Polars to replace increasing number of workloads on Spark to significantly decrease infrastructure cost and complexity.Mon, 15 Sep 2025 00:00:00 GMTArnaud Vennin (Tech Lead Data Engineer @ Decathlon)https://pola.rs/posts/polars-cloud-launch/https://pola.rs/posts/polars-cloud-launch/We launch Polars Cloud; the distributed Cloud Architecture to run Polars anywhereWed, 03 Sep 2025 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/talk-polars-meetup-2-at-scale/https://pola.rs/posts/talk-polars-meetup-2-at-scale/Ritchie Vink introduces Polars Cloud, the platform to scale Polars remotely with a novel distributed engineThu, 31 Jul 2025 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/uvm-larger-than-ram-gpu/https://pola.rs/posts/uvm-larger-than-ram-gpu/With the introduction Unified Virtual Memory (UVM), larger than memory data processesing is possible with the GPU engine. Learn more about the implementation and performance considerations.Thu, 26 Jun 2025 00:00:00 GMTThijs Nieuwdorp (Xomnia), Tom Drabas (NVIDIA)https://pola.rs/posts/benchmarks/https://pola.rs/posts/benchmarks/A fresh run of the PDS-H benchmark suite shows the performance of Polars versus other query processing engines.Sun, 01 Jun 2025 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/case-metro-digital/https://pola.rs/posts/case-metro-digital/METRO.digital migrated from SQL to Polars for KPI creation across 19 countries, improving code maintainability and reducing resource requirements while handling large datasets more efficiently.Thu, 24 Apr 2025 00:00:00 GMTDr. Patrick Bormann (Tech lead data scientist) @ METRO.digitalhttps://pola.rs/posts/talk-polars-meetup-1-streaming-engine/https://pola.rs/posts/talk-polars-meetup-1-streaming-engine/Orson Peters walks through the core architecture and internals of the new Polars streaming engineWed, 09 Apr 2025 00:00:00 GMTOrson Petershttps://pola.rs/posts/polars-cloud-what-we-are-building/https://pola.rs/posts/polars-cloud-what-we-are-building/We introduce Polars Cloud, the distributed cloud architecture to scale and run Polars anywhere.Mon, 10 Feb 2025 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/exploring-calendar-aware-date-operations-in-polars/https://pola.rs/posts/exploring-calendar-aware-date-operations-in-polars/Explore the calendar-aware date operations that Polars supports to simplify working with dates.Mon, 23 Dec 2024 00:00:00 GMTRodrigo Girão Serrãohttps://pola.rs/posts/breaking-the-rules-with-expression-expansion/https://pola.rs/posts/breaking-the-rules-with-expression-expansion/Polars has a rule that one expression must produce a single column as a result in a query. How do some expressions break this rule?Thu, 05 Dec 2024 00:00:00 GMTRodrigo Girão Serrãohttps://pola.rs/posts/polars-in-aggregate-dec24/https://pola.rs/posts/polars-in-aggregate-dec24/This edition covers plenty of performance improvements made to I/O, inequality joins, and much more.Wed, 04 Dec 2024 00:00:00 GMTRodrigo Girão Serrãohttps://pola.rs/posts/understanding-polars-data-types/https://pola.rs/posts/understanding-polars-data-types/Learn about all Polars data types, including when to use them and how to use them.Tue, 26 Nov 2024 00:00:00 GMTRodrigo Girão Serrãohttps://pola.rs/posts/talk-pydata-nyc-2024/https://pola.rs/posts/talk-pydata-nyc-2024/Ritchie Vink presents Polars GPU acceleration at PyData NYC 2024Mon, 25 Nov 2024 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/talk-pydata-amsterdam-2024/https://pola.rs/posts/talk-pydata-amsterdam-2024/Ritchie Vink presents Polars 1.0 and the arrival of GPU acceleration at PyData Amsterdam 2024Tue, 22 Oct 2024 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/case-db-systel/https://pola.rs/posts/case-db-systel/The largest german railway company achieves nearly 20x speedup in data processing and identifies significant potential for cost savings on cloud resources.Thu, 17 Oct 2024 00:00:00 GMTSebastian Folz, Maren Westermann (Machine Learning Engineers @ DB Systel GmbH)https://pola.rs/posts/case-joulen/https://pola.rs/posts/case-joulen/Joulen builds a highly scalable and cost-effective infrastructure with Polars to power tools to optimize the use of renewable assets.Wed, 25 Sep 2024 00:00:00 GMTLiam Brannigan (Data Team Lead) @ Joulen https://pola.rs/posts/gpu-engine-release/https://pola.rs/posts/gpu-engine-release/Polars and NVIDIA RAPIDS have worked together to bring GPU acceleration to Polars.Tue, 17 Sep 2024 00:00:00 GMTRitchie Vink, Robin van den Brink, Lawrence Mitchellhttps://pola.rs/posts/case-vydia/https://pola.rs/posts/case-vydia/Vydia uses Polars' Ruby interface to ingest and process a fast growing number of CSVs files on their Ruby based platform that empowers music labels.Fri, 13 Sep 2024 00:00:00 GMTDanny Correia (Software Engineering Manager) @ Vydiahttps://pola.rs/posts/lightweight_plotting/https://pola.rs/posts/lightweight_plotting/With Polars 1.6 a new lightweight plotting engine was introduced to create plots without additional dependencies.Wed, 04 Sep 2024 00:00:00 GMTMarco Gorelli (Polars core developer)https://pola.rs/posts/benchmark-energy-performance/https://pola.rs/posts/benchmark-energy-performance/A research team of the VU Amsterdam published a paper benchmarking the energy usage and performance of pandas and Polars data analysis Python libraries.Thu, 22 Aug 2024 00:00:00 GMTIvano Malavolta and Karolina Bargiełhttps://pola.rs/posts/case-double-river/https://pola.rs/posts/case-double-river/Double River achieves 10x speedups and 50% memory reduction in their financial models utilizing Polars plugins.Wed, 14 Aug 2024 00:00:00 GMTIsaac Robbins (Data Engineer) & Nelson Griffiths (Engineering & ML Lead) @ Double River Investmentshttps://pola.rs/posts/polars-hugging-face/https://pola.rs/posts/polars-hugging-face/Polars now supports native reading from Hugging face datasets Fri, 09 Aug 2024 00:00:00 GMTPolars Development Teamhttps://pola.rs/posts/polars-in-aggregate-juli24/https://pola.rs/posts/polars-in-aggregate-juli24/This edition covers improved support for Hive partitioning, right joins, Hugging Face integration and much more.Thu, 25 Jul 2024 00:00:00 GMTPolars dev teamhttps://pola.rs/posts/announcing-polars-1/https://pola.rs/posts/announcing-polars-1/We have released Python Polars 1.0. We are very excited to reach this milestone.Mon, 01 Jul 2024 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/case-mdpi/https://pola.rs/posts/case-mdpi/MDPI, a pioneer in open access scientific publishing, uses Polars to process hundreds of GBs of textual data on their on-premise infrastructure on a daily basis.Thu, 27 Jun 2024 00:00:00 GMTJean-Philippe Dubuc, Senior Data Engineer @ MDPIhttps://pola.rs/posts/polars-in-aggregate-jun24/https://pola.rs/posts/polars-in-aggregate-jun24/This Polars in Aggregate shares more insights in some selected changes released in the versions Polars 0.20.17 to Polars 0.20.31.Wed, 05 Jun 2024 00:00:00 GMTRobin van den Brink & Ritchie Vinkhttps://pola.rs/posts/talk-pycon-lithuania-2024/https://pola.rs/posts/talk-pycon-lithuania-2024/Ritchie Vink delivers a keynote on Polars at PyCon Lithuania 2024Thu, 02 May 2024 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/case-gresearch/https://pola.rs/posts/case-gresearch/G-Research is a leading quantitative finance research firm that uses Polars in different projects throughout the organization.Thu, 18 Apr 2024 00:00:00 GMTKieran Garvey (Senior L&D Partner) & Casey Haaland (Machine Learning Engineer) @ G-Researchhttps://pola.rs/posts/benchmarks-2024/https://pola.rs/posts/benchmarks-2024/A fresh run of the PDS-H benchmark suite shows the performance of Polars versus other query processing engines.Tue, 16 Apr 2024 00:00:00 GMTStijn de Gooijerhttps://pola.rs/posts/polars-on-gpu/https://pola.rs/posts/polars-on-gpu/Polars and NVIDIA are bringing GPU acceleration to Polars dataframes in the near future. With the collaboration Polars is able to fully utilize both the CPU and GPU, significantly speeding up certain workloads.Thu, 04 Apr 2024 00:00:00 GMTPolars & NVIDIAhttps://pola.rs/posts/polars-in-aggregate-mar24/https://pola.rs/posts/polars-in-aggregate-mar24/This edition covers support for streaming outer joins, zero-copy NumPy interop, COUNT(*) fast path, very fast boolean filters and ternary operations, and more.Thu, 28 Mar 2024 00:00:00 GMTPolars dev teamhttps://pola.rs/posts/predicate-pushdown-query-optimizer/https://pola.rs/posts/predicate-pushdown-query-optimizer/Predicate pushdown is one of the most important optimizations for a query engine. Read more about it in this article.Tue, 19 Mar 2024 00:00:00 GMTChiel Petershttps://pola.rs/posts/case-check-technology/https://pola.rs/posts/case-check-technology/Check Technologies is a Dutch multi-modal mobility provider in the Netherlands. They have successfully migrated all data pipelines from pandas to Polars and saved 25% on their cloud bills.Wed, 06 Mar 2024 00:00:00 GMTRobin van den Brink, Paul Duvenage (Check Technologies)https://pola.rs/posts/polars-in-aggregate-feb24/https://pola.rs/posts/polars-in-aggregate-feb24/Since the last issue of Polars in Aggregate, we had four Python releases (0.20.3 to 0.20.6) and a two Rust releases (0.36.2 and 0.37.0). These releases contained many performance improvements, bug fixes, breaking changes and new features.Wed, 07 Feb 2024 00:00:00 GMTRobin van den Brink, Ritchie Vinkhttps://pola.rs/posts/polars-string-type/https://pola.rs/posts/polars-string-type/We have completely rewritten the string/binary data structure we use in Polars.Tue, 30 Jan 2024 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/polars_birds_eye_view/https://pola.rs/posts/polars_birds_eye_view/Read how Polars executes your query from planning, optimizing to execution.Fri, 19 Jan 2024 00:00:00 GMTChiel Petershttps://pola.rs/posts/talk-global-devslam-2023/https://pola.rs/posts/talk-global-devslam-2023/Ritchie Vink introduces Polars at Global DevSlam 2023 in DubaiTue, 09 Jan 2024 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/polars_in_aggregrate-0.20https://pola.rs/posts/polars_in_aggregrate-0.20Polars moves fast. We typically release once a week. In this blog we explain the most notable changes from the last month.Thu, 04 Jan 2024 00:00:00 GMTRobin van den Brink, Ritchie Vinkhttps://pola.rs/posts/talk-pydata-plugins-keynote-2023/https://pola.rs/posts/talk-pydata-plugins-keynote-2023/Ritchie Vink presents a keynote on the Polars plugin system, enabling users to extend Polars with custom functionalityThu, 21 Dec 2023 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/talk-pydata-nyc-2023/https://pola.rs/posts/talk-pydata-nyc-2023/Polars is an OLAP query engine built from scratch in Rust to fully utilize modern multi-core hardwareWed, 29 Nov 2023 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/talk-pydata-amsterdam-2023/https://pola.rs/posts/talk-pydata-amsterdam-2023/A deep dive into why the expression engine in Polars is so versatile and fastWed, 22 Nov 2023 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/polars-0-19-upgrade-guide/https://pola.rs/posts/polars-0-19-upgrade-guide/An overview of breaking changes and deprecations in the latest Polars release.Thu, 31 Aug 2023 00:00:00 GMTStijn de Gooijerhttps://pola.rs/posts/company-announcement/https://pola.rs/posts/company-announcement/We are excited to announce the start of company that will build around Polars, enabling data processing at any scale.Thu, 03 Aug 2023 00:00:00 GMTRitchie Vink & Chiel Petershttps://pola.rs/posts/talk-europython-2023/https://pola.rs/posts/talk-europython-2023/Ritchie Vink explains what Polars does under the hood to make your data processing fasterThu, 20 Jul 2023 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/talk-pycon-lithuania-2023/https://pola.rs/posts/talk-pycon-lithuania-2023/Ritchie Vink presents how Polars has evolved beyond raw speed to tackle scaling challengesSat, 17 Jun 2023 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/benchmarks-2023/https://pola.rs/posts/benchmarks-2023/Benchmarking: under developmentSun, 01 Jan 2023 00:00:00 GMTPolarshttps://pola.rs/posts/pydata-global-2021/https://pola.rs/posts/pydata-global-2021/This talk will introduce Polars, a blazingly fast DataFrame library written in Rust on top of Apache ArrowSat, 22 Jan 2022 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/the-expressions-api-in-polars-is-amazing/https://pola.rs/posts/the-expressions-api-in-polars-is-amazing/Guest post by Vincent D. Warmerdam, research advocate at Rasa, creator of the calmcode.io project and maintainer of many open source projects.Sun, 21 Nov 2021 00:00:00 GMTVincent Warmerdamhttps://pola.rs/posts/talk-bristech-bytesize-conference/https://pola.rs/posts/talk-bristech-bytesize-conference/Bristech Bytesize #17: Polars, the fastest DataFrame library you never heard of... Panel with Joris van den Bossche & Jorge C. Leitão.Thu, 16 Sep 2021 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/talk-xomnia-data-drinks-2021/https://pola.rs/posts/talk-xomnia-data-drinks-2021/Ritchie Vink introduces Polars, the fastest DataFrame library you never heard of, at Xomnia's Data & Drinks seriesMon, 22 Mar 2021 00:00:00 GMTRitchie Vinkhttps://pola.rs/posts/i-wrote-one-of-the-fastest-dataframe-libraries/https://pola.rs/posts/i-wrote-one-of-the-fastest-dataframe-libraries/Some design decisions around the Polars DataFrame library.Sun, 28 Feb 2021 00:00:00 GMTRitchie Vink