2021-06-03 22:11:09 -04:00
|
|
|
.. _api.ml:
|
|
|
|
|
|
|
|
==========================
|
|
|
|
Machine Learning utilities
|
|
|
|
==========================
|
|
|
|
.. currentmodule:: pyspark.pandas.mlflow
|
|
|
|
|
|
|
|
MLflow
|
|
|
|
------
|
|
|
|
|
2021-06-11 07:42:38 -04:00
|
|
|
Arbitrary MLflow models can be used with pandas-on-Spark Dataframes,
|
2021-06-03 22:11:09 -04:00
|
|
|
provided they implement the 'pyfunc' flavor. This is the case
|
|
|
|
for most frameworks supported by MLflow (scikit-learn, pytorch,
|
|
|
|
tensorflow, ...). See comprehensive examples in
|
|
|
|
:func:`load_model` for more information.
|
|
|
|
|
|
|
|
.. note::
|
|
|
|
The MLflow package must be installed in order to use this module.
|
|
|
|
If MLflow is not installed in your environment already, you
|
|
|
|
can install it with the following command:
|
|
|
|
|
|
|
|
**pip install koalas[mlflow]**
|
|
|
|
|
|
|
|
.. autosummary::
|
|
|
|
:toctree: api/
|
|
|
|
|
|
|
|
PythonModelWrapper
|
|
|
|
load_model
|