o +&]i)@s4UddlmZddlZddlmZmZmZddlmZddl m Z ddl m Z ej rrddlZddlmZmZddlZddlZddlZddlmZdd l mZejd kr\dd lmZmZndd lmZmZdd l mZdd lm Z m!Z!ddgZ"Gdddeee fZ#eGddde#ee fZ$de%d<ddZ&dS)) annotationsN)Genericfinaloverload)IntoDataFrameT)_reader) IntoFrameT)AnyLiteral) DatasetCache)Reader) ) LiteralStringSelf)_Backend)Dataset ExtensionLoaderloadc@seZdZUdZded<ee d-d.d d Zeed/d d Zeed0dd Ze d1d2dd Zed3ddZ d4d5d#d$Z d4d6d&d'Z e d7d)d*Z d8d+d,Z dS)9raW Load example datasets *remotely* from `vega-datasets`_, with caching. A new ``Loader`` must be initialized by specifying a backend:: from altair.datasets import Loader load = Loader.from_backend("polars") load Loader[polars] .. _vega-datasets: https://github.com/vega/vega-datasets "Reader[IntoDataFrameT, IntoFrameT]r. backend_nameLiteral['polars']return"Loader[pl.DataFrame, pl.LazyFrame]cCdSNclsrrrU/var/www/html/IGF-ODF-V3/venv/lib/python3.10/site-packages/altair/datasets/_loader.py from_backend3zLoader.from_backend$Literal['pandas', 'pandas[pyarrow]']"Loader[pd.DataFrame, pd.DataFrame]cCrrrrrrr r!9r"Literal['pyarrow']Loader[pa.Table, pa.Table]cCrrrrrrr r!?r"polarsrtype[Loader[Any, Any]]rLoader[Any, Any]cCs|t|S)ad Initialize a new loader, with the specified backend. Parameters ---------- backend_name DataFrame package/config used to return data. * *polars*: Using `polars defaults`_ * *pandas*: Using `pandas defaults`_. * *pandas[pyarrow]*: Using ``dtype_backend="pyarrow"`` * *pyarrow*: (*Experimental*) .. warning:: Most datasets use a `JSON format not supported`_ by ``pyarrow`` Examples -------- Using ``polars``:: from altair.datasets import Loader load = Loader.from_backend("polars") cars = load("cars") type(cars) polars.dataframe.frame.DataFrame Using ``pandas``:: load = Loader.from_backend("pandas") cars = load("cars") type(cars) pandas.core.frame.DataFrame Using ``pandas``, backed by ``pyarrow`` dtypes:: load = Loader.from_backend("pandas[pyarrow]") co2 = load("co2") type(co2) pandas.core.frame.DataFrame co2.dtypes Date datetime64[ns] CO2 double[pyarrow] adjusted CO2 double[pyarrow] dtype: object .. _polars defaults: https://docs.pola.rs/api/python/stable/reference/io.html .. _pandas defaults: https://pandas.pydata.org/docs/reference/io.html .. _JSON format not supported: https://arrow.apache.org/docs/python/json.html#reading-json-files ) from_readerr _from_backendrrrr r!Es=readerrcCs||}||_|Sr)__new__r)rr,objrrr r*s zLoader.from_readerNnameDataset | LiteralStringsuffixExtension | Nonekwdsr rcKs|jj||fi|S)u7 Get a remote dataset and load as tabular data. Parameters ---------- name Name of the dataset/`Path.stem`_. suffix File extension/`Path.suffix`_. .. note:: Only needed if ``name`` is available in multiple formats. **kwds Arguments passed to the underlying read function. Examples -------- Using ``polars``:: from altair.datasets import Loader load = Loader.from_backend("polars") source = load("iowa_electricity") source.columns ['year', 'source', 'net_generation'] source.head(5) shape: (5, 3) ┌────────────┬──────────────┬────────────────┐ │ year ┆ source ┆ net_generation │ │ --- ┆ --- ┆ --- │ │ date ┆ str ┆ i64 │ ╞════════════╪══════════════╪════════════════╡ │ 2001-01-01 ┆ Fossil Fuels ┆ 35361 │ │ 2002-01-01 ┆ Fossil Fuels ┆ 35991 │ │ 2003-01-01 ┆ Fossil Fuels ┆ 36234 │ │ 2004-01-01 ┆ Fossil Fuels ┆ 36205 │ │ 2005-01-01 ┆ Fossil Fuels ┆ 36883 │ └────────────┴──────────────┴────────────────┘ Using ``pandas``:: load = Loader.from_backend("pandas") source = load("iowa_electricity") source.columns Index(['year', 'source', 'net_generation'], dtype='object') source.head(5) year source net_generation 0 2001-01-01 Fossil Fuels 35361 1 2002-01-01 Fossil Fuels 35991 2 2003-01-01 Fossil Fuels 36234 3 2004-01-01 Fossil Fuels 36205 4 2005-01-01 Fossil Fuels 36883 Using ``pyarrow``:: load = Loader.from_backend("pyarrow") source = load("iowa_electricity") source.column_names ['year', 'source', 'net_generation'] source.slice(0, 5) pyarrow.Table year: date32[day] source: string net_generation: int64 ---- year: [[2001-01-01,2002-01-01,2003-01-01,2004-01-01,2005-01-01]] source: [["Fossil Fuels","Fossil Fuels","Fossil Fuels","Fossil Fuels","Fossil Fuels"]] net_generation: [[35361,35991,36234,36205,36883]] .. _Path.stem: https://docs.python.org/3/library/pathlib.html#pathlib.PurePath.stem .. _Path.suffix: https://docs.python.org/3/library/pathlib.html#pathlib.PurePath.suffix )rdataset)selfr/r1r3rrr __call__sWzLoader.__call__strcCs|j||S)a Return the address of a remote dataset. Parameters ---------- name Name of the dataset/`Path.stem`_. suffix File extension/`Path.suffix`_. .. note:: Only needed if ``name`` is available in multiple formats. .. _Path.stem: https://docs.python.org/3/library/pathlib.html#pathlib.PurePath.stem .. _Path.suffix: https://docs.python.org/3/library/pathlib.html#pathlib.PurePath.suffix Examples -------- The returned url will always point to an accessible dataset:: import altair as alt from altair.datasets import Loader load = Loader.from_backend("polars") load.url("cars") "https://cdn.jsdelivr.net/npm/vega-datasets@v2.11.0/data/cars.json" We can pass the result directly to a chart:: url = load.url("cars") alt.Chart(url).mark_point().encode(x="Horsepower:Q", y="Miles_per_Gallon:Q") )rurl)r5r/r1rrr r8s(z Loader.urlr cCs|jjS)ab Caching of remote dataset requests. Configure cache path:: self.cache.path = "..." Download the latest datasets *ahead-of-time*:: self.cache.download_all() Remove all downloaded datasets:: self.cache.clear() Disable caching:: self.cache.path = None )rcacher5rrr r9 sz Loader.cachecCst|jd|jjdS)N[])type__name__r_namer:rrr __repr__$szLoader.__repr__).)rrrr)rr#rr$)rr%rr&)r')rr(rrrr))r,rrrr)r/r0r1r2r3r rr)r/r0r1r2rr7)rr )rr7)r> __module__ __qualname____doc____annotations__r classmethodr!r*r6r8propertyr9r@rrrr r!s2 >  \ * csteZdZe  ddd d Ze  dddd Ze  dddd Ze  dddd Z  d d!fdd ZZS)"_Load.backendNoner/r0r1r2r3r rrcKrrrr5r/r1rHr3rrr r6*z_Load.__call__r pl.DataFramecKrrrrJrrr r63rKr# pd.DataFramecKrrrrJrrr r6<rKr%pa.TablecKrrrrJrrr r6ErKN_Backend | None7IntoDataFrameT | pl.DataFrame | pd.DataFrame | pa.Tablec s6|durtj||fi|S||||fi|Sr)superr6r!rJ __class__rr r6Ns)..) rHrIr/r0r1r2r3r rr) rHrr/r0r1r2r3r rrL) rHr#r/r0r1r2r3r rrM) rHr%r/r0r1r2r3r rrN)NN) rHrOr/r0r1r2r3r rrP)r>rArBrr6 __classcell__rrrRr rG(s( rGz_Load[Any, Any]cCs6|dkrt}t|atSdtd|}t|)Nrzmodule z has no attribute )r infer_backendrGr*rr>AttributeError)r/r,msgrrr __getattr___s  rX)' __future__rtypingtrrrnarwhals.stable.v1.typingraltair.datasetsraltair.datasets._readerr TYPE_CHECKINGsysr r pandaspdr'plpyarrowpaaltair.datasets._cacher r version_inforrtyping_extensionsraltair.datasets._typingrr__all__rrGrDrXrrrr s6        3