- Added ignore_existing_pk option to all endpoints that accept update_on_existing_pk
- Added new endpoint /export/records/tofiles
- Added new endpoint /alter/directory
- Added new options
resource_group
anddefault_schema
to/create/user/external
endpoint - Added new option
directory_data_limit
to/create/user/internal
and/create/user/external
endpoints - Added new option
data_limit
to/create/directory
endpoint - Added new options
jdbc_session_init_statement
,jdbc_connection_init_statement
,remote_table
,use_st_geomfrom_casts
,use_indexed_parameters
to/export/records/totable
endpoint - Added new options
jdbc_session_init_statement
,remote_query_order_by
,num_splits_per_rank
to/insert/records/fromquery
endpoint
- Added support for Azure, HDFS, S3 and Google Cloud storage providers to
/create/datasink
and/alter/datasink
endpoints - Added rank option to
/alter/tier
- Added delete_orphaned_tables option to
/admin/verify_db
- Added new option compression_type for external files endpoints.
- Added support for Google Cloud Storage as a backend for cold storage and external data sources
- Added new endpoint /insert/records/fromquery
- Added new endpoint /export/records/totable
- Added new endpoint /upload/files/fromurl
- Added new options
gcs_bucket_name
,gcs_project_id
andgcs_service_account_keys
to endpoints/create/datasource
and/alter/datasource
- Added new options
gcs_service_account_id
andgcs_service_account_keys
to endpoints/create/credential
and/alter/credential
- Added new options
jdbc_driver_jar_path
andjdbc_driver_class_name
to endpoints/create/datasource
and/create/datasink
- Added new options
remote_query
andremote_query_filter_column
to/create/table/external
endpoint - Added new options
tcs_per_tom
,tps_per_tom
, andmax_concurrent_kernels
to/alter/system/properties
endpoint - Added new option
expression
to/get/records/fromcollection
endpoint - Added new options
create_temp_table
,result_table
,result_table_persist
, andttl
to endpoint/aggregate/k_means
- Added new info item
qualified_result_table_item
to response for endpoint/aggregate/k_means
- Added new solve method and its options,
match_charging_stations
for endpoint/match/graph/
- Added new internal option
simplify
to /create/graph and /modify/graph endpoints - Added new options
track_id_column_name
andtrack_order_column_name
to/visualize/image
and/visualize/image/classbreak
- Added new option
persist
to endpoints/alter/system/properties
,/alter/resourcegroup
, and/alter/tier
, which defaults to true
- Added new endpoint /repartition/graph
- Added new endpoint /show/resource/objects
- Existing option in insert/records/fromfiles, frompayload & create/table/external: bad_record_table_limit was per rank and now global
- Added new option in insert/records/fromfiles, frompayload & create/table/external: bad_record_table_limit_per_input: limit bad records to insert into bad_record_table_name when inserting from subscription or from multiple files
- Added new option
create_home_directory
to/create/user/internal
,/create/user/external
, and/create/directory
endpoints - Added
table_monitor
as a valid object type to/has/permission
,/grant/permission
and/revoke/permission
endpoints - Added new option
create_temp_table
to the following endpoints:/aggregate/groupby
/aggregate/unique
/aggregate/unpivot
/create/jointable
/create/projection
/create/table
/create/union
/filter
/filter/byarea
/filter/byarea/geometry
/filter/bybox
/filter/bybox/geometry
/filter/bygeometry
/filter/bylist
/filter/byradius
/filter/byradius/geometry
/filter/byrange
/filter/byseries
/filter/bystring
/filter/bytable
/filter/byvalue
/merge/records
- Added action type
stop_deployment
to/alter/model
endpoint - Added
deployments
details to/show/model
response - Added
owner_resource_group
details to/show/table
response - Added
graph_owner_resource_groups
to/show/graph
response - Added
data
field resource group entries of/show/resource/statistics
response - Added action type
change_owner
to the following endpoints:/alter/table
- Added option
cascade_delete
to/delete/resource/group
endpoint - Added new option
max_data
option to the following:/alter/resource/group
request/create/resource/group
request/show/resource/groups
response- Added option
show_tier_usage
to/show/resource/groups
endpoint /show/resource/groups
allows any user to query their group(s).- Added option
skip_lines
to external tables endpoints:/insert/records/fromfiles
,/insert/records/frompayload
,/create/table/external
- Added new option
use_managed_credentials
to the following endpoints:/create/datasource
/alter/datasource
- Added internal option
create_metadata
to/alter/system/properties
endpoint - Added internal option
get_auto_view_updators
to/alter/system/properties
endpoint
- Creation of named non-persistent tables now requires
table_admin
permission on the parent schema, as with persistent tables. Users withouttable_admin
permission on any schema may use the new optioncreate_temp_table
for a system-generated table name that does not requiretable_admin
permission. - Changed
delete_resource_group
to return an error if there are users associated with that group or if there are any tables or graphs owned by the group. - Changed
show_resource_groups
- Request will return an error if the user requests a group which does not exist, previously returned the default group.
- Changed default value of option
show_default_group
to be false if an explicit list of group names is provided. Previously was always true.
-
Added the following endpoints to support data sinks:
/alter/datasink
/create/datasink
/drop/datasink
/grant/permission
/has/role
/revoke/permission
/show/datasink
-
Added new endpoints for table monitors:
/show/tablemonitors
- Added new options
increasing_column
andexpression
to/create/tablemonitor endpoint
. - Added new options
monitor_id
,datasink_name
,destination
andkafka_topic_name
to/create/tablemonitor
endpoint. - Added new permission types
connect_datasink
andconnect_datasource
to/has/permission
endpoint. - Added new table monitor subscription event type
all
to create a monitor id for all events
- Added
shadow_cube_replacement_policy
option to/alter/system/properties
endpoint - Added
audit_response
option to/alter/system/properties
endpoint - Added new file type: avro in external files endpoints
- Fields in the
/has/permission
were changed to match/grant/permission
.
-
Added the following endpoints to support video:
/alter/video
/create/video
/get/video
/show/video
-
Added the following endpoints to support the KiFS global file namespace:
/create/directory
/delete/directory
/delete/files
/download/files
/grant/permission/directory
/revoke/permission/directory
/show/directories
/show/files
/upload/files
-
New endpoints to support database backup:
/admin/backup/begin
/admin/backup/end
-
Other new endpoints:
/has/permission
- Added new options to
/alter/system/properties
kafka_batch_size
kafka_wait_time
kafka_timeout
- Added new actions to
/alter/table
cancel_datasource_subscription
pause_datasource_subscription
resume_datasource_subscription
- Removed
kafka_group_id
option from/create/datasource
- Added
kafka_group_id
option to/create/table/external
/insert/records/fromfiles
- Added
datasource_subscriptions
additional info option to/show/table
response - Added a new option
inverse_solve
for thematch_batch_solves
solver of/match/graph
. - Added a new solve method
match_loops
for/match/graph
with two additional options:min_loop_level
max_loop_level
- Added new
/match/graph
options formatch_loops
solve to improve performance:output_batch_size
search_limit
- The
/match/graph
endpoint has a new option added for MSDO solver option. The new opton name ismax_truck_stops
. If specified (greater than zero), a truck can at most have this many stops (demand locations) in one round trip. Otherwise, it is unlimited. Ifenable_truck_reuse
is on, this condition will be applied separately at each round trip use of the same truck. - Added two solvers to the
/solve/graph
endpoint:STATS_ALL
CLOSENESS
(for centrality)
- Added new
/solve/graph
options forpage_rank
solve to improve performance:convergence_limit
max_iterations
- Changed default
type_inference_mode
tospeed
- for 3 external files endpoints:/create/table/external
,/insert/records/fromfiles
, &/insert/records/frompayload
- New options to
/create/table/external
,/insert/records/fromfiles
, &/insert/records/frompayload
:text_search_columns
&text_search_min_column_length
. /create/table/external
,/insert/records/fromfile
new option:table_insert_mode
with valid_choices:table_per_file
,single
(default 0)/create/table/external
,/insert/records/fromfile
and/insert/records/frompayload
new value for option:file_type
:shapefile
- Added
max_output_lines
option to/execute/proc
to limit captured stdout and stderr output
/solve/graph
internal option for distributed solves/show/graph
added info about partitioned graphs as well as graph memory/admin/show/jobs
Addedflags
field to response to provide additional job metadata/show/proc/status
addedoutput
field to response to return captured stdout and stderr output
- Added the following endpoints to support credentials:
/alter/credential
/create/credential
/drop/credential
/show/credential
/grant/permission/credential
/revoke/permission/credential
- Added a new
credential
option to the following endpoints:/create/datasource
/alter/datasource
- The
output_tracks
option is added for the/match/graph
solvermatch_supply_demand
for timestamped tracks generation directly and accurately. - All graph endpoints except for
/delete/graph
and/modify/graph
can now to aserver_id
as an option. /admin/reblance
&/admin/remove/ranks
optionaggressiveness
defaults to 10- Added execute_as option to
/create/materializedview
and/alter/table
endpoints. /create/table/external
,/insert/records/fromfile
and/insert/records/frompayload
new option:type_inference_mode
with valid_choices:accuracy
,speed
/create/table/external
,/insert/records/fromfile
and/insert/records/frompayload
new option:max_records_to_load
(default=0: load all)/create/table/external
,/insert/records/fromfile
and/insert/records/frompayload
new option:store_points_as_xy
andstore_points_as_xyz
(both have same meaning)
- Multiple graph servers support:
/create/graph
and/modify/graph
response now has aresult
field indicating success on all graph servers./show/graph
- Response now provide info about which graph server each graph is on.
- Will also provide some extra info about each server (CPU load and memory)
/show/system/properties
graph parameters are now vectorized and prefixed withgraph
./show/system status
replacedgraph_status
by vector of graph status similar to ranks.
/admin/add/ranks
,/admin/remove/ranks
, and/admin/rebalance
now require the database to be offline
/create/type
- Added
uuid
as a new column property. - Added
init_with_uuid
as a new column property foruuid
column.
- Added
/create/table endpoint
: addedSERIES
to thevalid_choices
for thepartition_type
- Added the following endpoints to support cluster resiliency:
/admin/add/host
/admin/alter/host
/admin/remove/host
/admin/switchover
- Added the following endpoints to support SQL schemas:
/create/schema
/alter/schema
/drop/schema
/show/schema
/has/schema
- Added the following endpoints to support data source:
/create/datasource
/alter/datasource
/drop/datasource
/show/datasource
/grant/permission/datasource
/revoke/permission/datasource
-
Deprecated
collection_name
parameters wherever they appear. The new method is to qualify the table name or set the default schema. -
Added
qualified_table_name
to the response info map for the following endpoints:/create/materializedview
/create/table
/create/union
/merge/records
-
Added
qualified_projection_name
to the response info map for the following endpoints:/create/projection
-
Added
qualified_result_table_name
to the response info map for the following endpoints:/aggregate/groupby
/aggregate/unique
/aggregate/unpivot
-
Added
qualified_table_name
to the response info map for the following endpoints:/filter
/filter/byarea
/filter/byarea/geometry
/filter/bybox
/filter/bybox/geometry
/filter/bygeometry
/filter/bylist
/filter/byradius
/filter/byradius/geometry
/filter/byrange
/filter/byseries
/filter/bystring
/filter/bytable
/filter/byvalue
-
/admin/rebalance
- Renamed option
table_whitelist
toinclude_tables
- Renamed option
table_blacklist
toexclude_tables
- Renamed option
-
/alter/system/properties
- Removed
enable_compound_equi_join
as an option
- Removed
-
/alter/user
- Added
set_default_schema
as an action
- Added
-
/alter/table
- Added
move_to_schema
as an action
- Added
-
/show/table
- Added
schema_name
toadditional_info
map - Added the following
table_descriptions
:LOGICAL_VIEW
,LOGICAL_EXTERNAL_TABLE
,MATERIALIZED_EXTERNAL_TABLE
, &SCHEMA
- Added
-
Added
cb_pointalphas
option andcb_pointalpha_attrs
andcb_pointalpha_vals
fields to/visualize/image/classbreak
to support manipulation of transparency in class-break visualization.
/admin/add/ranks
- changed
added_ranks
parameter in response to an array of strings - removed
results
parameter from response
- changed
/admin/remove/ranks
- changed
ranks
parameter in request to an array of strings - changed
removed_ranks
parameter in response to an array of strings - removed
results
parameter from response
- changed
- xxx
- xxx
- Added
execute_as
additional_info map key to/show/sql/proc
response.
- Added 'output_edge_path' (default=false) and 'output_wkt_path' (default=true) options for turning on and off ability to export out aggregated path lists columns onto the solution table for the path solvers of /solve/graph endpoint for more speed.
- /create/table endpoint: added "SERIES" to the
valid_choices
for thepartition_type
- Added
cb_pointalphas
option andcb_pointalpha_attrs
andcb_pointalpha_vals
fields tovisualize/image/classbreak
to support manipulation of transparency in class-break visualization.
- Added a job_tag option to the following endpoints:
/create/job
/get/job
/admin/alter/job
- Added a job_tag field to
/show/job
- /match/graph option 'enable_truck_reuse' added for supply demand solver of /match/graph for reusing truck in multiple rounds from the same originating depot
- /match/graph option 'truck_service_limit' added for sypply demand solver of /match/graph as an additional constraint on the total cost of any truck's delivery route.
- /match/graph option 'max_num_threads" added for multi-core support for many trips map matching. If specified it will not be exceeded but it can be lower due to memory and number of core threads availibility.
- /match/graph solve_method 'incremental_weighted' is removed as it was defunc.
- /match/graph option 'unit_unloading_cost' added for match_supply_demand_solver type to add unloading time to the optimization.
- /match/graph option 'filter_folding_paths' added for the markov_chain solver type to filter out the folding paths for more accurate results.
- /match/graph option 'max_trip_cost' added for match_supply_demand solver type to restrict trips between stops excedding this number except from/to the origin.
- /solve/graph option 'accurate_snaps' added.
- /match/graph for solve type 'match_supply_demand' only: the option 'aggregated_output' (default: true) added
- /create/graph, /modify/graph: newly added option of 'add_turns' (default: false), 'turn_angle' (default: 60)
- /solve/graph, /match/graph: newly added options of 'left_turn_penaly', 'right_turn_penalty', 'intersection_penalty', 'sharp_turn_penalty' (default: 0.0)
- /solve/graph Added 'output_edge_path' (default=false) and 'output_wkt_path' (default=true) options for turning on and off ability to export out aggregated path lists columns onto the solutioon table for the path solvers of /solve/graph endpoint for more speed.
- Added
datasource_name
option to/create/external/table
and/insert/records/from/files
- Added 'unit_unloading_cost' option is added to the /match/graph endpoint for match_supply_demand solve case to add the unloading time per drop amount.
- Added total_number_of_records and has_more_records to /get/records/fromcollection response info map.
- Added "count" to the info map in the responses for create_projection, create_union and execute_sql.
- Added a new endpoint
/insert/records/fromfiles
to insert records from external files into a new or existing table. - Added a new endpoint
/modify/graph
for updates of an existing graph in a non-streaming fashion.
- Added an option
remove_label_only
to create and modify graph endpoints (see option's doc) - Added
enable_overlapped_equi_join
andenable_compound_equi_join
options to/alter/system/properties
- Added
columns
andsql_where
options to/grant/permission/table
- Add
additional_info
map to/show/sql/proc
to list attributes of sql procedures.
-
Added
allpaths
solve graph option to solve for all the paths between source and destination. It is recommended to run this with the options of max and min solution radiua set carefully. The min value should be greater than or equal to the shortest path cost and it is further advised to set the max_number_targets option to limit the resulting paths. -
Added
modify
create graph option. Whenrecreate
andmodify
is both true for an existing graph it'll update the graph instead of deleting and recreating it. -
Added
match_batch_solves
solver type valid choice to the/match/graph
endpoint'ssolve_method
parameter. This solver is strictly for WKTPOINT source and destination pairs with an ID and runs as many shortest paths as there are unique source and destination pairs provided as efficiently as possible. This change was made to bridge the gap for theshortest_path
solver in batch mode only for WKTPOINT node types in/solve/graph
because it is not possible to match the ID of the pair in the solution_table. -
Added
execute_interval
andexecute_start_time
to the/show/sql/proc
. -
Added default values for parameters
offset
andlimit
to the following endpoints:/aggregate/groupby
/aggregate/unique
/execute/sql
/get/records/bycolumn
-
Changed default limit from 10k to -9999 (END_OF_SET) for the following endpoints:
/aggregate/groupby
/aggregate/unique
/execute/sql
/get/records/bycolumn
/get/records/fromcollection
/get/records
-
Added "compact_after_rebalance", "compact_only", and "repair_incorrectly_sharded_data" options to /admin/rebalance
- Added new
/show/sql/proc
endpoint to show SQL Procedure definitions
- Updated the
/solve/graph/
endpoint to remove clunky and obscure primary parameters:- Removed
source_node
,source_node_id
,destination_node_ids
, andnode_type
parameters - Added
source_nodes
parameter as vector of strings that is of NODE component type. For backwards compatibility, one of the following could be passed to bothsource_nodes
anddestination_nodes
:["{'POINT(10 10)'} AS NODE_WKTPOINT"]
["POINT(10 10)"]
["table.column AS NODE_WKTPOINT"]
- Removed
- In the case of
backhaul_routing
solver type, the fixed assets are now placed insource_nodes
and the remote assets are placed indestination_nodes
instead of having all assets being placed indestination_nodes
and the number of fixed assets being placed insource_node_id
- Added
bad_record_indices
anderror_N
info map keys to/insert/records
response - Added
evict_columns
option to/alter/system/properties
- Added
return_individual_errors
,allow_partial_batch
, anddry_run
options to/insert/records
- Added
retain_partitions
option to/create/projection
. This option will cause the projection to be created with the same partition scheme as the source table, if possible. In prior versions, this was the default behavior but we are now making it optional and turned off by default. - Added a
max_combinations
option to/match/graph
formatch_supply_demand
solver type - Added
index_type
option to/alter/table
. This option affects thecreate_index
anddelete_index
actions and can have a value ofcolumn
(the default) orchunk_skip
. Setting the option tocolumn
will create/delete a standard attribute index while the value ofchunk_skip
will create/delete a chunk-skip index, which is useful in cases where there are large numbers of chunks (i.e. due to partitioning).
- Added
truncate_strings
option to/update/records
- Added
match_supply_demand
solver type valid choice to the/match/graph
endpoint'ssolve_method
parameter - Added
partial_loading
option to/match/graph
- Added support for the
ulong
(unsigned long) property within thestring
type to/create/type
-
Added internal
/show/graph/grammar
endpoint to be consumed by GAdmin -
Added internal
/alter/graph
endpoint to enable cancelling graph jobs -
Added the following endpoints to support proc (UDF) execute permissions:
/grant/permission/proc
/revoke/permission/proc
-
Added
/show/graph
to show basic properties of one or all graphs on the graph server
- Moved
rings
option to a top-level parameter in/query/graph
- Added
aggressiveness
option to/admin/rebalance
and/admin/remove/ranks
- Added
show_async_jobs
option to/admin/show/jobs
to enable showing completed async jobs as they are no longer shown by default
- Aligned
/visualize/isochrone
options
parameter with thecontour_options
andsolve_options
parameters - Added
use_priority_queue_solvers
option to/visualize/isochrone
to accelerate solve times for small to medium underlying graphs
-
Added the following endpoints for resource management:
/create/resourcegroup
/show/resourcegroups
/alter/resourcegroup
/delete/resourcegroup
/alter/tier
- Updated
/create/user/internal
to handle resource group names
- Added
info
string-to-string map to the responses of all endpoints. This map will contain additional information that may vary from endpoint to endpoint - Updated
/show/security
response to include resource group names - Updated
/create/user/internal
response to handle resource group names
- Added the following endpoints to submit synchronously running jobs and retrieve the results of the job:
/create/job
/get/job
- Added
/create/materializedview
endpoint
- Added
max_concurrency_per_node
option to/create/proc
-
Added the following geometry-specific endpoints:
/aggregate/minmax/geometry
/filter/byarea/geometry
/filter/bybox/geometry
/filter/byradius/geometry
- The following endpoints no longer support operations on geometry columns:
/aggregate/minmax
/filter/byarea
/filter/bybox
/filter/byradius
- Added support for the
wkt
property within thestring
type to/create/type
- Added support for column names other than "WKT" to
/filter/bygeometry
- Added
/has/proc
endpoint to support external procs
- Moved
execution_mode
option to a top-level parameter in/create/proc
- Modified
/execute/proc
- Shuffled
/create/projection
parameter order
- Added
timings
to the/show/proc
response - The following supported values have been added to
action
in/alter/table
:add_column
delete_column
change_column
rename_table
- The following options have been added to
/alter/table
:column_default_value
column_properties
column_type
validate_change_column
copy_values_from_column
rename_column
- Added support for the following properties to
/create/type
:decimal
(base typestring
)date
(base typestring
)time
(base typestring
)
- The following supported values have been added to
mode
in/create/union
:union_all
(default)union
union_distinct
except
intersect
- The following options have been added to
/create/projection
:expression
limit
- Added /create/projection endpoint for selecting a subset of columns (including derived columns) from a table into a new result table with optional sorting
- Added the following external proc support endpoints:
/create/proc
/delete/proc
/execute/proc
(replaces Node.js-exclusive version)/kill/proc
/show/proc
/show/proc/status
- Null values for nullable columns are now supported in
/update/records
- Added the following security system endpoints:
/alter/user
/create/role
/create/user/external
/create/user/internal
/delete/role
/delete/user
/grant/permission/system
/grant/permission/table
/grant/role
/revoke/permission/system
/revoke/permission/table
/revoke/role
/show/security
- Added the
/create/union
endpoint
/alter/table/properties
merged into/alter/table
/show/table/properties
merged into/show/table
/visualize/image/heatmap
has additional style options and a simplified schema
/get/records
now shows if there are more records to retrieve- Added
percentile
to the list of supported values forstats
in/aggregate/statistics
- Added support for changing the maximum request timeout time to
/alter/system/properties
- Added
not_in_list
to the list of supported values for thefilter_mode
option in/filter/bylist
to enable inverse matching - Added
result_table
option to/aggregate/groupby
- Added support for
arg_min
,arg_max
, andcount_distinct
aggregates to/aggregate/groupby
- Added
result_table
option to/aggregate/unique
- Added
having
option to/aggregate/groupby
- Refactor schemas and integrate documentation into JSON schemas