15 stable releases (4 major)
6.0.0+20240607 | Oct 15, 2024 |
---|---|
5.0.4+20240127 | Mar 5, 2024 |
3.1.0+20220212 | Apr 26, 2022 |
3.0.0+20220212 | Mar 8, 2022 |
1.0.6+20170926 | Sep 27, 2017 |
#16 in Machine learning
44 downloads per month
1.5MB
21K
SLoC
The ml1
command-line interface (CLI) allows to use most features of the Google Cloud Machine Learning Engine service from the comfort of your terminal.
By default all output is printed to standard out, but flags can be set to direct it into a file independent of your shell's capabilities. Errors will be printed to standard error, and cause the program's exit code to be non-zero.
If data-structures are requested, these will be returned as pretty-printed JSON, to be useful as input to other tools.
Everything else about the Cloud Machine Learning Engine API can be found at the official documentation site.
Installation and Source Code
Install the command-line interface with cargo using:
cargo install google-ml1-cli
Find the source code on github.
Usage
This documentation was generated from the Cloud Machine Learning Engine API at revision 20240607. The CLI is at version 6.0.0.
ml1 [options]
projects
explain <name> (-r <kv>)... [-p <v>]... [-o <out>]
get-config <name> [-p <v>]... [-o <out>]
jobs-cancel <name> (-r <kv>)... [-p <v>]... [-o <out>]
jobs-create <parent> (-r <kv>)... [-p <v>]... [-o <out>]
jobs-get <name> [-p <v>]... [-o <out>]
jobs-get-iam-policy <resource> [-p <v>]... [-o <out>]
jobs-list <parent> [-p <v>]... [-o <out>]
jobs-patch <name> (-r <kv>)... [-p <v>]... [-o <out>]
jobs-set-iam-policy <resource> (-r <kv>)... [-p <v>]... [-o <out>]
jobs-test-iam-permissions <resource> (-r <kv>)... [-p <v>]... [-o <out>]
locations-get <name> [-p <v>]... [-o <out>]
locations-list <parent> [-p <v>]... [-o <out>]
locations-operations-cancel <name> [-p <v>]... [-o <out>]
locations-operations-get <name> [-p <v>]... [-o <out>]
locations-studies-create <parent> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-delete <name> [-p <v>]... [-o <out>]
locations-studies-get <name> [-p <v>]... [-o <out>]
locations-studies-list <parent> [-p <v>]... [-o <out>]
locations-studies-trials-add-measurement <name> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-trials-check-early-stopping-state <name> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-trials-complete <name> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-trials-create <parent> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-trials-delete <name> [-p <v>]... [-o <out>]
locations-studies-trials-get <name> [-p <v>]... [-o <out>]
locations-studies-trials-list <parent> [-p <v>]... [-o <out>]
locations-studies-trials-list-optimal-trials <parent> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-trials-stop <name> (-r <kv>)... [-p <v>]... [-o <out>]
locations-studies-trials-suggest <parent> (-r <kv>)... [-p <v>]... [-o <out>]
models-create <parent> (-r <kv>)... [-p <v>]... [-o <out>]
models-delete <name> [-p <v>]... [-o <out>]
models-get <name> [-p <v>]... [-o <out>]
models-get-iam-policy <resource> [-p <v>]... [-o <out>]
models-list <parent> [-p <v>]... [-o <out>]
models-patch <name> (-r <kv>)... [-p <v>]... [-o <out>]
models-set-iam-policy <resource> (-r <kv>)... [-p <v>]... [-o <out>]
models-test-iam-permissions <resource> (-r <kv>)... [-p <v>]... [-o <out>]
models-versions-create <parent> (-r <kv>)... [-p <v>]... [-o <out>]
models-versions-delete <name> [-p <v>]... [-o <out>]
models-versions-get <name> [-p <v>]... [-o <out>]
models-versions-list <parent> [-p <v>]... [-o <out>]
models-versions-patch <name> (-r <kv>)... [-p <v>]... [-o <out>]
models-versions-set-default <name> (-r <kv>)... [-p <v>]... [-o <out>]
operations-cancel <name> [-p <v>]... [-o <out>]
operations-get <name> [-p <v>]... [-o <out>]
operations-list <name> [-p <v>]... [-o <out>]
predict <name> (-r <kv>)... [-p <v>]... [-o <out>]
ml1 --help
Configuration:
[--scope <url>]...
Specify the authentication a method should be executed in. Each scope
requires the user to grant this application permission to use it.
If unset, it defaults to the shortest scope url for a particular method.
--config-dir <folder>
A directory into which we will store our persistent data. Defaults to
a user-writable directory that we will create during the first invocation.
[default: ~/.google-service-cli]
Configuration
The program will store all persistent data in the ~/.google-service-cli
directory in JSON files prefixed with ml1-
. You can change the directory used to store configuration with the --config-dir
flag on a per-invocation basis.
More information about the various kinds of persistent data are given in the following paragraphs.
Authentication
Most APIs require a user to authenticate any request. If this is the case, the scope determines the set of permissions granted. The granularity of these is usually no more than read-only or full-access.
If not set, the system will automatically select the smallest feasible scope, e.g. when invoking a
method that is read-only, it will ask only for a read-only scope.
You may use the --scope
flag to specify a scope directly.
All applicable scopes are documented in the respective method's CLI documentation.
The first time a scope is used, the user is asked for permission. Follow the instructions given by the CLI to grant permissions, or to decline.
If a scope was authenticated by the user, the respective information will be stored as JSON in the configuration
directory, e.g. ~/.google-service-cli/ml1-token-<scope-hash>.json
. No manual management of these tokens
is necessary.
To revoke granted authentication, please refer to the official documentation.
Application Secrets
In order to allow any application to use Google services, it will need to be registered using the Google Developer Console. APIs the application may use are then enabled for it one by one. Most APIs can be used for free and have a daily quota.
To allow more comfortable usage of the CLI without forcing anyone to register an own application, the CLI comes with a default application secret that is configured accordingly. This also means that heavy usage all around the world may deplete the daily quota.
You can workaround this limitation by putting your own secrets file at this location:
~/.google-service-cli/ml1-secret.json
, assuming that the required ml API
was enabled for it. Such a secret file can be downloaded in the Google Developer Console at
APIs & auth -> Credentials -> Download JSON and used as is.
Learn more about how to setup Google projects and enable APIs using the official documentation.
Debugging
Even though the CLI does its best to provide usable error messages, sometimes it might be desirable to know what exactly led to a particular issue. This is done by allowing all client-server communication to be output to standard error as-is.
The --debug
flag will print errors using the Debug
representation to standard error.
You may consider redirecting standard error into a file for ease of use, e.g. ml1 --debug <resource> <method> [options] 2>debug.txt
.
Dependencies
~22–33MB
~598K SLoC