Lithops-2.5.5

Added

• [CLI] Allow to pass all available 'docker' parameter to 'lithops runtime build' command, by @JosepSampe

Fixed

• [Localhost] Fixed minor issue when deleting completed jobs, by @JosepSampe
• [Multiprocessing] Fixed args mismatch error when passing list of tuples to Pool.map, by @aitorarjona
• [Standalone] Fixed cloud-init script that occasionally fails to set ssh credentials, by @JosepSampe

Version 2.5.4

Fixes

• [Standalone] Avoid deleting the master VM on consume mode, by @JosepSampe

Lithops-2.5.3

Fixes

• [Core] Fixed lithops.map_reduce() jobs. Sometimes jobs where not finishing, by @JosepSampe
• [Core] Spawn lithops.cleaner only once in the same execution instance, by @JosepSampe
• [Tests] Fix when running 'lithops verify' command, by @JosepSampe
• [CodeEngine] Delete jobruns and configmaps of internal executions, by @JosepSampe
• [k8s] Delete job definitions of internal executions, by @JosepSampe
• [Core] Ensure all temp data is cleaned from storage backend, by @JosepSampe

Lithops-2.5.2

Added

• [Core] Allow to spawn the reduce function in map_reduce() after a configurable percentage of completed map activations, by @JosepSampe

Changed

• [Config] 'max_workers' and 'worker_processess' keys must be set at backend level in config, by @JosepSampe
• [Config] 'remote_invoker' key must be set at backend level in config, by @JosepSampe
• [Config] 'customized_runtime' key must be set at lithops level in config, by @JosepSampe
• [Config] 'serverless' section in config is no longer required, by @JosepSampe

Fixes

• [CodeEngine] Fixed 'max_workers' parameter to limit the number of max workers per map invocation, by @JosepSampe
• [IBM CF] Create the runtime if not deployed when invoked, by @JosepSampe
• [Localhost] Fix localhost paths for windows hosts, by @JosepSampe

Lithops-2.5.1

Added

• [Localhost] Stop containers on ctrl-c, by @JosepSampe

Changed

• [Localhost] Start container with user's uid:gid, by @JosepSampe
• [Localhost] Extended default execution timeout to 3600 seconds, by @JosepSampe

Fixes

• [Standalone] Fixed standalone execution on consume mode, by @kpavel
• [Aliyun FC] Fixed Aliyun Function compute backend, by @JosepSampe
• [Core] Fixed 'lithops runtime build' command when the backend is not configured in config, by @JosepSampe

Lithops-2.5.0

Added

• [CLI] Add new command in cli to list deployed runtimes, by @JosepSampe
• [Standalone] Add reuse mode that allows to reuse the same VMs for all the maps, by @kpavel
• [Config] allow to configure worker_processes parameter in serverless and standalone sections, by @JosepSampe
• [Localhost] Prevent multiple jobs in the same executor to run at the same time, by @JosepSampe
• [Standalone] Prevent multiple jobs submitted to the same master VM to run at the same time, by @JosepSampe
• [CE] Added COS Direct endpoints for free bandwidth from/to CodeEngine, by @JosepSampe

Changed

• [Core] worker_processes parameter has been moved from map() to FunctionExecutor(), by @JosepSampe
• [CE] Deleted docker naming restrictions in CE and k8s backends, by @JosepSampe
• [CLI] Prevent loading storage config when using 'lithops runtime build' command, by @JosepSampe
• [AWS Lambda] Moved layer build to a lambda, solves OS related errors when compiling libraries, by @aitorarjona
• [AWS Lambda] Adjusted new memory configurations (128 MB minimum and removed 64 MB increments check), by @aitorarjona
• [AWS Lambda] Add support for Python3.9, by @aitorarjona
• [Standalone] ssh VM password is now a 37 chars random and dynamic password (for create and resue modes), by @JosepSampe

Fixed

• [CE] Create a new token when it expires after 20 minutes when using the same FunctionExecutor, by @JosepSampe
• [CE] Prevent exception when detecting the docker username in k8s and CE backends, by @JosepSampe
• [Core] Fix minor issue in jobrunner, by @JosepSampe
• [AWS Lambda] Fixed aws config max timeout check, by @danielbraun89
• [Standalone] Fixed issue that prevents to run multiple maps() with the same FunctionExecutor (create mode), by @JosepSampe

Lithops-2.4.1

Fixes

• [IBM VPC] Fixed a data inconsistency on consume mode, by @JosepSampe

Version 2.4.0

Added

• [Storage] Added MinIO storage backend, by @JosepSampe
• [Core] Allow to pass function args as part of the invocation payload in FaaS backends, by @JosepSampe
• [Core] Optimize call_async() calls with an internal function caching system, by @JosepSampe
• [AWS Lambda] New invoke method that reduces total invocation time, by @aitorarjona
• [Core] Allow to set the bucket name at storage backend level in config, by @JosepSampe
• [localhost] stop running jobs processes on ctrl-c or exception, by @JosepSampe
• [AWS S3] Added region_name parameter in config, by @aitorarjona

Changed

• [Core] Improved performance and efficiency of the lithops cleaner background process, by @JosepSampe
• [AWS Lambda] Use layer from Klayers API for pre-compiled Amazon Linux numpy binaries, by @aitorarjona
• [Core] Moved invoke_pool_threads param from map and map_reduce calls. Now it must be set at backend level in config, by @JosepSampe

Fixes

• [Localhost] Fixed error when processing localhost objects, by @JosepSampe
• [Localhost] Allow to create a localhost storage instance when a config file exists with a cloud configuration, by @JosepSampe
• [Core] Fixed an unusual inconsistency in configuration between 'backend' and 'mode' parameters, by @JosepSampe
• [Core] Fixed customized_runtime feature, by @JosepSampe
• [Core] Fixed get_result() execution after wait() when throw_except is set to False, by @JosepSampe
• [Core] Fixed internal executions, by @JosepSampe
• [Core] Fixed 'lithops storage list' CLI when a bucket is empty, by @JosepSampe
• [Standalone] Fixed execution, by @JosepSampe

Lithops-2.3.5

Added

• [Core] Add function chaining pattern in the Futures API, by @JosepSampe
• [Core] ob.data_stream is now also an iterator when using the partitioner, by @JosepSampe
• [AWS Lambda] Add 'account_id' parameter in config (used if present instead of querying STS), by @aitorarjona
• [k8s] Allow to set the maximum number of parallel workers, by @JosepSampe
• [Localhost] Allow the partitioner to process local directories, by @JosepSampe

Changed

• [Core] Add 'key' and 'bucket' attrs in localhost partitioner for compatibility with OS, by @JosepSampe
• [Serverless] runtime, runtime_memory and runtime_timeout can only be set at backend level, by @JosepSampe

Fixed

• [Standalone] Fix execution, by @JosepSampe
• [Core] Avoid loading the config file twice, by @JosepSampe

Lithops-2.3.4

Added

• [Core] Allow to execute a Class as lithops function, by @JosepSampe
• [CE] Allow to to run code engine without kubecfg file, by @JosepSampe
• [CE] Allow private container registries, by @JosepSampe
• [k8s] Allow private container registries, by @JosepSampe
• [knative] Allow private container registries, by @JosepSampe
• [Localhost] Allow the partitioner to process local files, by @JosepSampe
• [joblib] Added joblib entry in extras_require for joblib backend dependencies, by @aitorarjona

Changed

• [CE] CPU and memory values must match predefined flavors, by @JosepSampe
• [multiprocessing] Improved nanomsg Pipe implementation, by @aitorarjona
• [joblib] Optimized joblib backend (concurrent args data upload/download), by @aitorarjona

Fixed

• [Core] Fixed module analyzer, by @JosepSampe
• [Core] Clear only present jobs instead of all after wait() or get_result(), by @JosepSampe
• [multiprocessing] Fix put/get slice to/from mp.Array or mp.RawArray, by @aitorarjona