CHANGELOG.md

Apache Arrow 0.15.0 (30 September 2019)

Bug

• ARROW-1184 - [Java] Dictionary.equals is not working correctly
• ARROW-2317 - [Python] fix C linkage warning
• ARROW-2490 - [C++] input stream locking inconsistent
• ARROW-3176 - [Python] Overflow in Date32 column conversion to pandas
• ARROW-3203 - [C++] Build error on Debian Buster
• ARROW-3651 - [Python] Datetimes from non-DateTimeIndex cannot be deserialized
• ARROW-3652 - [Python] CategoricalIndex is lost after reading back
• ARROW-3762 - [C++] Parquet arrow::Table reads error when overflowing capacity of BinaryArray
• ARROW-3933 - [Python] Segfault reading Parquet files from GNOMAD
• ARROW-4187 - [C++] file-benchmark uses <poll.h>
• ARROW-4746 - [C++/Python] PyDataTime_Date wrongly casted to PyDataTime_DateTime
• ARROW-4836 - [Python] "Cannot tell() a compressed stream" when using RecordBatchStreamWriter
• ARROW-4848 - [C++] Static libparquet not compiled with -DARROW_STATIC on Windows
• ARROW-4880 - [Python] python/asv-build.sh is probably broken after CMake refactor
• ARROW-4883 - [Python] read_csv() returns garbage if given file object in text mode
• ARROW-5028 - [Python][C++] Creating list with pyarrow.array can overflow child builder
• ARROW-5085 - [Python/C++] Conversion of dict encoded null column fails in parquet writing when using RowGroups
• ARROW-5086 - [Python] Space leak in ParquetFile.read_row_group()
• ARROW-5089 - [C++/Python] Writing dictionary encoded columns to parquet is extremely slow when using chunk size
• ARROW-5125 - [Python] Cannot roundtrip extreme dates through pyarrow
• ARROW-5220 - [Python] index / unknown columns in specified schema in Table.from_pandas
• ARROW-5292 - [C++] Static libraries are built on AppVeyor
• ARROW-5300 - [C++] 0.13 FAILED to build with option -DARROW_NO_DEFAULT_MEMORY_POOL
• ARROW-5374 - [Python] Misleading error message when calling pyarrow.read_record_batch on a complete IPC stream
• ARROW-5414 - [C++] Using "Ninja" build system generator overrides default Release build type on Windows
• ARROW-5450 - [Python] TimestampArray.to_pylist() fails with OverflowError: Python int too large to convert to C long
• ARROW-5471 - [C++][Gandiva]Array offset is ignored in Gandiva projector
• ARROW-5522 - [Packaging][Documentation] Comments out of date in python/manylinux1/build_arrow.sh
• ARROW-5560 - [C++][Plasma] Cannot create Plasma object after OutOfMemory error
• ARROW-5562 - [C++][Parquet] parquet writer does not handle negative zero correctly
• ARROW-5630 - [Python][Parquet] Table of nested arrays doesn't round trip
• ARROW-5638 - [C++] cmake fails to generate Xcode project when Gandiva JNI bindings are enabled
• ARROW-5651 - [Python] Incorrect conversion from strided Numpy array when other type is specified
• ARROW-5682 - [Python] from_pandas conversion casts values to string inconsistently
• ARROW-5731 - [CI] Turbodbc integration tests are failing
• ARROW-5753 - [Rust] Fix test failure in CI code coverage
• ARROW-5772 - [GLib][Plasma][CUDA] Plasma::Client#refer_object test is failed
• ARROW-5775 - [C++] StructArray : cached boxed fields not thread-safe
• ARROW-5776 - [Gandiva][Crossbow] Revert template to have commit ids.
• ARROW-5790 - [Python] Passing zero-dim numpy array to pa.array causes segfault
• ARROW-5817 - [Python] Use pytest marks for Flight test to avoid silently skipping unit tests due to import failures
• ARROW-5823 - [Rust] CI scripts miss --all-targets cargo argument
• ARROW-5824 - [Gandiva] [C++] Fix decimal null
• ARROW-5836 - [Java][OSX] Flight tests are failing: address already in use
• ARROW-5838 - [C++][Flight][OSX] Building 3rdparty grpc cannot find OpenSSL
• ARROW-5848 - [C++] SO versioning schema after release 1.0.0
• ARROW-5849 - [C++] Compiler warnings on mingw-w64
• ARROW-5851 - [C++] Compilation of reference benchmarks fails
• ARROW-5856 - [Python] linking 3rd party cython modules against pyarrow fails since 0.14.0
• ARROW-5860 - [Java] [Vector] Fix decimal byte setter
• ARROW-5863 - [Python] Segmentation Fault via pytest-runner
• ARROW-5868 - [Python] manylinux2010 wheels have shared library dependency on liblz4
• ARROW-5870 - [C++] Development compile instructions need to include "make"
• ARROW-5873 - [Python] Segmentation fault when comparing schema with None
• ARROW-5874 - [Python] pyarrow 0.14.0 macOS wheels depend on shared libs under /usr/local/opt
• ARROW-5878 - [Python][C++] Parquet reader not forward compatible for timestamps without timezone
• ARROW-5884 - [Java] Fix the get method of StructVector
• ARROW-5886 - [Python][Packaging] Manylinux1/2010 compliance issue with libz
• ARROW-5887 - [C#] ArrowStreamWriter writes FieldNodes in wrong order
• ARROW-5889 - [Python][C++] Parquet backwards compat for timestamps without timezone broken
• ARROW-5894 - [C++] libgandiva.so.14 is exporting libstdc++ symbols
• ARROW-5899 - [Python][Packaging] Bundle uriparser.dll in windows wheels
• ARROW-5910 - [Python] read_tensor() fails on non-seekable streams
• ARROW-5921 - [C++][Fuzzing] Missing nullptr checks in IPC
• ARROW-5923 - [C++] Fix int96 comment
• ARROW-5925 - [Gandiva][C++] cast decimal to int should round up
• ARROW-5930 - [FlightRPC] [Python] Flight CI tests are failing
• ARROW-5935 - [C++] ArrayBuilders with mutable type are not robustly supported
• ARROW-5946 - [Rust] [DataFusion] Projection push down with aggregate producing incorrect results
• ARROW-5952 - [Python] Segfault when reading empty table with category as pandas dataframe
• ARROW-5959 - [C++][CI] Fuzzit does not know about branch + commit hash
• ARROW-5960 - [C++] Boost dependencies are specified in wrong order
• ARROW-5963 - [R] R Appveyor job does not test changes in the C++ library
• ARROW-5964 - [C++][Gandiva] Cast double to decimal with rounding returns 0
• ARROW-5966 - [Python] Capacity error when converting large UTF32 numpy array to arrow array
• ARROW-5968 - [Java] Remove duplicate Preconditions check in JDBC adapter
• ARROW-5969 - [CI] [R] Lint failures
• ARROW-5973 - [Java] Variable width vectors' get methods should return null when the underlying data is null
• ARROW-5989 - [C++][Python] pyarrow.lib.ArrowIOError: Unable to load libjvm when using openjdk-8
• ARROW-5990 - [Python] RowGroupMetaData.column misses bounds check
• ARROW-5992 - [C++] Array::View fails for string/utf8 as binary
• ARROW-5996 - [Java] Avoid resource leak in flight service
• ARROW-5999 - [C++] Required header files missing when built with -DARROW_DATASET=OFF
• ARROW-6002 - [C++][Gandiva] TestCastFunctions does not test int64 casting`
• ARROW-6004 - [C++] CSV reader ignore_empty_lines option doesn't handle empty lines
• ARROW-6005 - [C++] parquet::arrow::FileReader::GetRecordBatchReader() does not behave as documented since ARROW-1012
• ARROW-6006 - [C++] Empty IPC streams containing a dictionary are corrupt
• ARROW-6012 - [C++] Fall back on known Apache mirror for Thrift downloads
• ARROW-6016 - [Python] pyarrow get_library_dirs assertion error
• ARROW-6029 - [R] Improve R docs on how to fix library version mismatch
• ARROW-6032 - [C++] CountSetBits doesn't ensure 64-bit aligned accesses
• ARROW-6038 - [Python] pyarrow.Table.from_batches produces corrupted table if any of the batches were empty
• ARROW-6040 - [Java] Dictionary entries are required in IPC streams even when empty
• ARROW-6046 - [C++] Slice RecordBatch of String array with offset 0 returns whole batch
• ARROW-6047 - [Rust] Rust nightly 1.38.0 builds failing
• ARROW-6050 - [Java] Update out-of-date java/flight/README.md
• ARROW-6054 - pyarrow.serialize should respect the value of structured dtype of numpy
• ARROW-6058 - [Python][Parquet] Failure when reading Parquet file from S3 with s3fs
• ARROW-6060 - [Python] too large memory cost using pyarrow.parquet.read_table with use_threads=True
• ARROW-6061 - [C++] Cannot build libarrow without rapidjson
• ARROW-6066 - [Website] Fix blog post author header
• ARROW-6067 - [Python] Large memory test failures
• ARROW-6068 - [Python] Hypothesis test failure, Add StructType::Make that accepts vector of fields
• ARROW-6073 - [C++] Decimal128Builder is not reset in Finish()
• ARROW-6082 - [Python] create pa.dictionary() type with non-integer indices type crashes
• ARROW-6092 - [C++] Python 2.7: arrow_python_test failure
• ARROW-6095 - [C++] Python subproject ignores ARROW_TEST_LINKAGE
• ARROW-6108 - [C++] Appveyor Build_Debug configuration is hanging in C++ unit tests
• ARROW-6116 - [C++][Gandiva] Fix bug in TimedTestFilterAdd2
• ARROW-6117 - [Java] Fix the set method of FixedSizeBinaryVector
• ARROW-6120 - [C++][Gandiva] including some headers causes decimal_test to fail
• ARROW-6126 - [C++] IPC stream reader handling of empty streams potentially not robust
• ARROW-6132 - [Python] ListArray.from_arrays does not check validity of input arrays
• ARROW-6135 - [C++] KeyValueMetadata::Equals should not be order-sensitive
• ARROW-6136 - [FlightRPC][Java] Don't double-close response stream
• ARROW-6145 - [Java] UnionVector created by MinorType#getNewVector could not keep field type info properly
• ARROW-6148 - [C++][Packaging] Improve aarch64 support
• ARROW-6152 - [C++][Parquet] Write arrow::Array directly into parquet::TypedColumnWriter
• ARROW-6153 - [R] Address parquet deprecation warning
• ARROW-6158 - [Python] possible to create StructArray with type that conflicts with child array's types
• ARROW-6159 - [C++] PrettyPrint of arrow::Schema missing identation for first line
• ARROW-6160 - [Java] AbstractStructVector#getPrimitiveVectors fails to work with complex child vectors
• ARROW-6166 - [Go] Slice of slice causes index out of range panic
• ARROW-6167 - [R] macOS binary R packages on CRAN don't have arrow_available
• ARROW-6170 - [R] "docker-compose build r" is slow
• ARROW-6171 - [R] "docker-compose run r" fails
• ARROW-6174 - [C++] Validate chunks in ChunkedArray::Validate
• ARROW-6175 - [Java] Fix MapVector#getMinorType and extend AbstractContainerVector addOrGet complex vector API
• ARROW-6178 - [Developer] Don't fail in merge script on bad primary author input in multi-author PRs
• ARROW-6182 - [R] Add note to README about r-arrow conda installation
• ARROW-6186 - [Packaging][C++] Plasma headers not included for ubuntu-xenial libplasma-dev debian package
• ARROW-6190 - [C++] Define and declare functions regardless of NDEBUG
• ARROW-6200 - [Java] Method getBufferSizeFor in BaseRepeatedValueVector/ListVector not correct
• ARROW-6202 - [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646
• ARROW-6205 - [C++] ARROW_DEPRECATED warning when including io/interfaces.h from CUDA (.cu) source
• ARROW-6208 - [Java] Correct byte order before comparing in ByteFunctionHelpers
• ARROW-6210 - [Java] remove equals API from ValueVector
• ARROW-6211 - [Java] Remove dependency on RangeEqualsVisitor from ValueVector interface
• ARROW-6214 - [R] Sanitizer errors triggered via R bindings
• ARROW-6215 - [Java] RangeEqualVisitor does not properly compare ZeroVector
• ARROW-6223 - [C++] Configuration error with Anaconda Python 3.7.4
• ARROW-6224 - [Python] remaining usages of the 'data' attribute (from previous Column) cause warnings
• ARROW-6227 - [Python] pyarrow.array() shouldn't coerce np.nan to string
• ARROW-6234 - [Java] ListVector hashCode() is not correct
• ARROW-6241 - [Java] Failures on master
• ARROW-6259 - [C++][CI] Flatbuffers-related failures in CI on macOS
• ARROW-6263 - [Python] RecordBatch.from_arrays does not check array types against a passed schema
• ARROW-6266 - [Java] Resolve the ambiguous method overload in RangeEqualsVisitor
• ARROW-6268 - Empty buffer should have a valid address
• ARROW-6269 - [C++][Fuzzing] IPC reads do not check decimal precision
• ARROW-6270 - [C++][Fuzzing] IPC reads do not check buffer indices
• ARROW-6290 - [Rust] [DataFusion] sql_csv example errors when running
• ARROW-6291 - [C++] CMake ignores ARROW_PARQUET
• ARROW-6301 - [Python] atexit: pyarrow.lib.ArrowKeyError: 'No type extension with name arrow.py_extension_type found'
• ARROW-6302 - [Python][Parquet] Reading dictionary type with serialized Arrow schema does not restore "ordered" type property
• ARROW-6309 - [C++] Parquet tests and executables are linked statically
• ARROW-6323 - [R] Expand file paths when passing to readers
• ARROW-6325 - [Python] wrong conversion of DataFrame with boolean values
• ARROW-6330 - [C++] Include missing headers in api.h
• ARROW-6332 - [Java][C++][Gandiva] Handle size of varchar vectors correctly
• ARROW-6339 - [Python][C++] Rowgroup statistics for pd.NaT array ill defined
• ARROW-6343 - [Java] [Vector] Fix allocation helper
• ARROW-6344 - [C++][Gandiva] substring does not handle multibyte characters
• ARROW-6345 - [C++][Python] "ordered" flag seemingly not taken into account when comparing DictionaryType values for equality
• ARROW-6348 - [R] arrow::read_csv_arrow namespace error when package not loaded
• ARROW-6354 - [C++] Building without Parquet fails
• ARROW-6363 - [R] segfault in Table__from_dots with unexpected schema
• ARROW-6364 - [R] Handling unexpected input to time64() et al
• ARROW-6369 - [Python] Support list-of-boolean in Array.to_pandas conversion
• ARROW-6371 - [Doc] Row to columnar conversion example mentions arrow::Column in comments
• ARROW-6372 - [Rust][Datafusion] Casting from Un-signed to Signed Integers not supported
• ARROW-6376 - [Developer] PR merge script has "master" target ref hard-coded
• ARROW-6387 - [Archery] Errors with make
• ARROW-6392 - [Python][Flight] list_actions Server RPC is not tested in test_flight.py, nor is return value validated
• ARROW-6406 - [C++] jemalloc_ep fails for offline build
• ARROW-6411 - [C++][Parquet] DictEncoderImpl::PutIndicesTyped has bad performance on some systems
• ARROW-6412 - [C++] arrow-flight-test can crash because of port allocation
• ARROW-6418 - [C++] Plasma cmake targets are not exported
• ARROW-6423 - [Python] pyarrow.CompressedOutputStream() never completes with compression='snappy'
• ARROW-6424 - [C++][Fuzzing] Fuzzit nightly is broken
• ARROW-6428 - [CI][Crossbow] Nightly turbodbc job fails
• ARROW-6431 - [Python] Test suite fails without pandas installed
• ARROW-6432 - [CI][Crossbow] Remove alpine crossbow jobs
• ARROW-6433 - [CI][Crossbow] Nightly java docker job fails
• ARROW-6434 - [CI][Crossbow] Nightly HDFS integration job fails
• ARROW-6435 - [CI][Crossbow] Nightly dask integration job fails
• ARROW-6440 - [CI][Crossbow] Nightly ubuntu, debian, and centos package builds fail
• ARROW-6441 - [CI][Crossbow] Nightly Centos 6 job fails
• ARROW-6443 - [CI][Crossbow] Nightly conda osx builds fail
• ARROW-6445 - [CI][Crossbow] Nightly Gandiva jar trusty job fails
• ARROW-6446 - [OSX][Python][Wheel] Turn off ORC feature in the wheel building scripts
• ARROW-6449 - [R] io "tell()" methods are inconsistently named and untested
• ARROW-6457 - [C++] CMake build locally fails with MSVC 2015 build generator
• ARROW-6461 - [Java] EchoServer can close socket before client has finished reading
• ARROW-6472 - [Java] ValueVector#accept may has potential cast exception
• ARROW-6476 - [Java][CI] Travis java all-jdks job is broken
• ARROW-6478 - [C++] Roll back to jemalloc stable-4 branch until performance issues in 5.2.x addressed
• ARROW-6481 - [Python][C++] Bad performance of read_csv() with column_types
• ARROW-6488 - [Python] pyarrow.NULL equals to itself
• ARROW-6492 - [Python] file written with latest fastparquet cannot be read with latest pyarrow
• ARROW-6502 - [GLib][CI] MinGW failure in CI
• ARROW-6506 - [C++] Validation of ExtensionType with nested type fails
• ARROW-6509 - [C++][Gandiva] Re-enable Gandiva JNI tests and fix Travis CI failure
• ARROW-6520 - [Python] Segmentation fault on writing tables with fixed size binary fields
• ARROW-6522 - [Python] Test suite fails with pandas 0.23.4, pytest 3.8.1
• ARROW-6530 - [CI][Crossbow][R] Nightly R job doesn't install all dependencies
• ARROW-6550 - [C++] Filter expressions PR failing manylinux package builds
• ARROW-6552 - [C++] boost::optional in STL test fails compiling in gcc 4.8.2
• ARROW-6560 - [Python] Failures in *-nopandas integration tests
• ARROW-6561 - [Python] pandas-master integration test failure
• ARROW-6562 - [GLib] Fix wrong sliced data of GArrowBuffer
• ARROW-6564 - [Python] Do not require pandas for invoking Array.__array__
• ARROW-6565 - [Rust] [DataFusion] Intermittent test failure due to temp dir already existing
• ARROW-6568 - [C++][Python][Parquet] pyarrow.parquet crash writing zero-chunk dictionary-type column
• ARROW-6572 - [C++] Reading some Parquet data can return uninitialized memory
• ARROW-6573 - [Python] Segfault when writing to parquet
• ARROW-6576 - [R] Fix sparklyr integration tests
• ARROW-6597 - [Python] Segfault in test_pandas with Python 2.7
• ARROW-6618 - [Python] Reading a zero-size buffer can segfault
• ARROW-6622 - [C++][R] SubTreeFileSystem path error on Windows
• ARROW-6623 - [CI][Python] Dask docker integration test broken perhaps by statistics-related change
• ARROW-6639 - [Packaging][RPM] Add support for CentOS 7 on aarch64
• ARROW-6640 - [C++] Error when BufferedInputStream Peek more than bytes buffered
• ARROW-6642 - [Python] chained access of ParquetDataset's metadata segfaults
• ARROW-6651 - [R] Fix R conda job
• ARROW-6652 - [Python] to_pandas conversion removes timezone from type
• ARROW-6660 - [Rust] [DataFusion] Minor docs update for 0.15.0 release
• ARROW-6670 - [CI][R] Fix fix for R nightly jobs
• ARROW-6674 - [Python] Fix or ignore the test warnings
• ARROW-6677 - [FlightRPC][C++] Document using Flight in C++
• ARROW-6678 - [C++] Regression in Parquet file compatibility introduced by ARROW-3246
• ARROW-6679 - [RELEASE] autobrew license in LICENSE.txt is not acceptable
• ARROW-6682 - [C#] Arrow R/C++ hangs reading binary file generated by C#
• ARROW-6687 - [Rust] [DataFusion] Query returns incorrect row count
• ARROW-6701 - [C++][R] Lint failing on R cpp code
• ARROW-6703 - [Packaging][Linux] Restore ARROW_VERSION environment variable
• ARROW-6705 - [Rust] [DataFusion] README has invalid github URL
• ARROW-6709 - [JAVA] Jdbc adapter currentIndex should increment when value is null
• ARROW-6714 - [R] Fix untested RecordBatchWriter case
• ARROW-6716 - [CI] [Rust] New 1.40.0 nightly causing builds to fail

Improvement

• ARROW-1324 - [C++] Support ARROW_BOOST_VENDORED on Windows / MSVC
• ARROW-1789 - [Format] Consolidate specification documents and improve clarity for new implementation authors
• ARROW-2769 - [C++][Python] Deprecate and rename add_metadata methods
• ARROW-3032 - [Python] Clean up NumPy-related C++ headers
• ARROW-3243 - [C++] Upgrade jemalloc to version 5
• ARROW-3246 - [Python][Parquet] direct reading/writing of pandas categoricals in parquet
• ARROW-3325 - [Python] Support reading Parquet binary/string columns directly as DictionaryArray
• ARROW-3531 - [Python] Deprecate Schema.field_by_name in favor of __getitem__
• ARROW-3579 - [Crossbow] Unintuitive error message when remote branch has not been pushed
• ARROW-3643 - [Rust] Optimize `push_slice` of `BufferBuilder`
• ARROW-3710 - [Crossbow][Python] Run nightly tests against pandas master
• ARROW-3772 - [C++] Read Parquet dictionary encoded ColumnChunks directly into an Arrow DictionaryArray
• ARROW-3829 - [Python] Support protocols to extract Arrow objects from third-party classes
• ARROW-3943 - [R] Write vignette for R package
• ARROW-4036 - [C++] Make status codes pluggable
• ARROW-4095 - [C++] Implement optimizations for dictionary unification where dictionaries are prefixes of the unified dictionary
• ARROW-4111 - [Python] Create time types from Python sequences of integers
• ARROW-4220 - [Python] Add buffered input and output stream ASV benchmarks with simulated high latency IO
• ARROW-4398 - [Python] Add benchmarks for Arrow<>Parquet BYTE_ARRAY serialization (read and write)
• ARROW-4473 - [Website] Add instructions to do a test-deploy of Arrow website and fix bugs
• ARROW-4648 - [C++/Question] Naming/organizational inconsistencies in cpp codebase
• ARROW-4649 - [C++/CI/R] Add (nightly) job that builds `brew install apache-arrow --HEAD`
• ARROW-4752 - [Rust] Add explicit SIMD vectorization for the divide kernel
• ARROW-4810 - [Format][C++] Add "LargeList" type with 64-bit offsets
• ARROW-4841 - [C++] Persist CMake options in generated CMake config
• ARROW-5134 - [R][CI] Run nightly tests against multiple R versions
• ARROW-5211 - [Format] Missing documentation under `Dictionary encoding` section on MetaData page
• ARROW-5216 - [CI] Add Appveyor badge to README
• ARROW-5307 - [CI][GLib] Enable GTK-Doc
• ARROW-5343 - [C++] Consider using Buffer for transpose maps in DictionaryType::Unify instead of std::vector
• ARROW-5344 - [C++] Use ArrayDataVisitor in implementation of dictionary unpacking in compute/kernels/cast.cc
• ARROW-5358 - [Rust] Implement equality check for ArrayData and Array
• ARROW-5380 - [C++] Fix and enable UBSan for unaligned accesses.
• ARROW-5439 - [Java] Utilize stream EOS in File format
• ARROW-5444 - [Release][Website] After 0.14 release, update what is an "official" release
• ARROW-5458 - [C++] ARMv8 parallel CRC32c computation optimization
• ARROW-5480 - [Python] Pandas categorical type doesn't survive a round-trip through parquet
• ARROW-5494 - [Python] Create FileSystem bindings
• ARROW-5505 - [R] Stop masking base R functions/rethink namespacing
• ARROW-5527 - [C++] HashTable/MemoTable should use Buffer(s)/Builder(s) for heap data
• ARROW-5558 - [C++] Support Array::View on arrays with non-zero offsets
• ARROW-5559 - [C++] Introduce IpcOptions struct object for better API-stability when adding new options
• ARROW-5564 - [C++] Add uriparser to conda-forge
• ARROW-5610 - [Python] Define extension type API in Python to "receive" or "send" a foreign extension type
• ARROW-5646 - [Crossbow][Documentation] Move the user guide to the Sphinx documentation
• ARROW-5681 - [FlightRPC] Wrap gRPC exceptions/statuses
• ARROW-5686 - [R] Review R Windows CI build
• ARROW-5716 - [Developer] Improve merge PR script to acknowledge co-authors
• ARROW-5717 - [Python] Support dictionary unification when converting variable dictionaries to pandas
• ARROW-5722 - [Rust] Implement std::fmt::Debug for ListArray, BinaryArray and StructArray
• ARROW-5734 - [Python] Dispatch to Table.from_arrays from pyarrow.table factory function
• ARROW-5736 - [Format][C++] Support small bit-width indices in sparse tensor
• ARROW-5741 - [JS] Make numeric vector from functions consistent with TypedArray.from
• ARROW-5743 - [C++] Add CMake option to enable "large memory" unit tests
• ARROW-5746 - [Website] Move website source out of apache/arrow
• ARROW-5747 - [C++] Better column name and header support in CSV reader
• ARROW-5762 - [Integration][JS] Integration Tests for Map Type
• ARROW-5777 - [C++] BasicDecimal128 is a small object it doesn't always make sense to pass by const ref
• ARROW-5778 - [Java] Extract the logic for vector data copying to the super classes
• ARROW-5784 - [Release][GLib] Replace c_glib/ after running c_glib/autogen.sh in dev/release/02-source.sh
• ARROW-5786 - [Release] Use arrow-jni profile in dev/release/01-prepare.sh
• ARROW-5788 - [Rust] Use { version = "...", path = "../..." } for arrow and parquet dependencies
• ARROW-5789 - [C++] Small Warning/Linkage cleanups
• ARROW-5798 - [Packaging][deb] Update doc architecture
• ARROW-5800 - [R] Dockerize R Travis CI tests so they can be run anywhere via docker-compose
• ARROW-5803 - [C++] Dockerize C++ with clang 7 Travis CI unit test logic
• ARROW-5812 - [Java] Refactor method name and param type in BaseIntVector
• ARROW-5813 - [C++] Support checking the equality of the different contiguous tensors
• ARROW-5814 - [Java] Implement a <Object, int> HashMap for DictionaryEncoder
• ARROW-5827 - [C++] Require c-ares CMake config
• ARROW-5828 - [C++] Add Protocol Buffers version check
• ARROW-5830 - [C++] Stop using memcmp in TensorEquals
• ARROW-5833 - [C++] Factor out status copying code from cast.cc
• ARROW-5842 - [Java] Revise the semantic of lastSet in ListVector
• ARROW-5843 - [Java] Improve the readability and performance of BitVectorHelper#getNullCount
• ARROW-5853 - [Python] Expose boolean filter kernel on Array
• ARROW-5864 - [Python] simplify cython wrapping of Result
• ARROW-5865 - [Release] Helper script for rebasing open pull requests on master
• ARROW-5866 - [C++] Remove duplicate library in cpp/Brewfile
• ARROW-5876 - [FlightRPC] Implement basic auth across all languages
• ARROW-5877 - [FlightRPC] Fix auth incompatibilities between Python/Java
• ARROW-5880 - [C++] Update arrow parquet writer to use TypedBufferBuilder
• ARROW-5883 - [Java] Support dictionary encoding for List and Struct type
• ARROW-5888 - [Python][C++] Add metadata to store Arrow time zones in Parquet file metadata
• ARROW-5897 - [Java] Remove duplicated logic in MapVector
• ARROW-5900 - [Gandiva] [Java] Decimal precision,scale bounds check
• ARROW-5904 - [Java] [Plasma] Fix compilation of Plasma Java client
• ARROW-5906 - [CI] Set -DARROW_VERBOSE_THIRDPARTY_BUILD=OFF in builds running in Travis CI, maybe all docker-compose builds by default
• ARROW-5908 - [C#] ArrowStreamWriter doesn't align buffers to 8 bytes
• ARROW-5909 - [Java] Optimize ByteFunctionHelpers equals & compare logic
• ARROW-5911 - [Java] Make ListVector and MapVector create reader lazily
• ARROW-5918 - [Java] Add get to BaseIntVector interface
• ARROW-5919 - [R] Add nightly tests for building r-arrow with dependencies from conda-forge
• ARROW-5924 - [C++][Plasma] It is not convenient to release a GPU object
• ARROW-5937 - [Release] Stop parallel binary upload
• ARROW-5938 - [Release] Create branch for adding release note automatically
• ARROW-5939 - [Release] Add support for generating vote email template separately
• ARROW-5940 - [Release] Add support for re-uploading sign/checksum for binary artifacts
• ARROW-5941 - [Release] Avoid re-uploading already uploaded binary artifacts
• ARROW-5943 - [GLib][Gandiva] Add support for function aliases
• ARROW-5947 - [Rust] [DataFusion] Remove serde_json dependency
• ARROW-5948 - [Rust] [DataFusion] create_logical_plan should not call optimizer
• ARROW-5955 - [Plasma] Support setting memory quotas per plasma client for better isolation
• ARROW-5961 - [R] Be able to run R-only tests even without C++ library
• ARROW-5962 - [CI][Python] Do not test manylinux1 wheels in Travis CI
• ARROW-5967 - [Java] DateUtility#timeZoneList is not correct
• ARROW-5976 - [C++] RETURN_IF_ERROR(ctx) should be namespaced
• ARROW-5977 - [C++] [Python] Method for read_csv to limit which columns are read?
• ARROW-5985 - [Developer] Do not suggest setting Fix Version for point releases in dev/merge_arrow_pr.py
• ARROW-5986 - [Java] Code cleanup for dictionary encoding
• ARROW-5998 - [Java] Open a document to track the API changes
• ARROW-6000 - [Python] Expose LargeBinaryType and LargeStringType
• ARROW-6017 - [FlightRPC] Allow creating Locations with unknown schemes
• ARROW-6020 - [Java] Refactor ByteFunctionHelper#hash with new added ArrowBufHasher
• ARROW-6021 - [Java] Extract copyFrom and copyFromSafe methods to ValueVector interface
• ARROW-6036 - [GLib] Add support for skip rows and column_names CSV read option
• ARROW-6037 - [GLib] Add a missing version macro
• ARROW-6041 - [Website] Blog post announcing R package release
• ARROW-6042 - [C++] Implement alternative DictionaryBuilder that always yields int32 indices
• ARROW-6045 - [C++] Benchmark for Parquet float and NaN encoding/decoding
• ARROW-6048 - [C++] Add ChunkedArray::View which calls to Array::View
• ARROW-6049 - [C++] Support using Array::View from compatible dictionary type to another
• ARROW-6063 - [FlightRPC] Implement "half-closed" semantics for DoPut
• ARROW-6065 - [C++] Reorganize parquet/arrow/reader.cc, remove code duplication, improve readability
• ARROW-6070 - [Java] Avoid creating new schema before IPC sending
• ARROW-6077 - [C++][Parquet] Build logical schema tree mapping Arrow fields to Parquet schema levels
• ARROW-6083 - [Java] Refactor Jdbc adapter consume logic
• ARROW-6084 - [Python] Support LargeList
• ARROW-6093 - [Java] reduce branches in algo for first match in VectorRangeSearcher
• ARROW-6096 - [C++] Conditionally depend on boost regex library
• ARROW-6100 - [Rust] Pin to specific Rust nightly release
• ARROW-6104 - [Rust] [DataFusion] Don't allow bare_trait_objects
• ARROW-6105 - [C++][Parquet][Python] Add test case showing dictionary-encoded subfields in nested type
• ARROW-6115 - [Python] support LargeList, LargeString, LargeBinary in conversion to pandas
• ARROW-6118 - [Java] Replace google Preconditions with Arrow Preconditions
• ARROW-6121 - [Tools] Improve merge tool cli ergonomic
• ARROW-6125 - [Python] Remove any APIs deprecated prior to 0.14.x
• ARROW-6127 - [Website] Add favicons and meta tags
• ARROW-6128 - [C++] Can't build with g++ 8.3.0 by class-memaccess warning
• ARROW-6130 - [Release] Use 0.15.0 as the next release
• ARROW-6139 - [Documentation][R] Build R docs (pkgdown) site and add to arrow-site
• ARROW-6141 - [C++] Enable memory-mapping a file region that is offset from the beginning of the file
• ARROW-6143 - [Java] Unify the copyFrom and copyFromSafe methods for all vectors
• ARROW-6172 - [Java] Provide benchmarks to set IntVector with different methods
• ARROW-6180 - [C++] Create InputStream that is an isolated reader of a segment of a RandomAccessFile
• ARROW-6181 - [R] Only allow R package to install without libarrow on linux
• ARROW-6187 - [C++] fallback to storage type when writing ExtensionType to Parquet
• ARROW-6192 - [GLib] Use the same SO version as C++
• ARROW-6194 - [Java] Add non-static approach in DictionaryEncoder making it easy to extend and reuse
• ARROW-6206 - [Java][Docs] Document environment variables/java properties
• ARROW-6209 - [Java] Extract set null method to the base class for fixed width vectors
• ARROW-6216 - [C++] Allow user to select the compression level
• ARROW-6219 - [Java] Add API for JDBC adapter that can convert less then the full result set at a time.
• ARROW-6225 - [Website] Update arrow-site/README and any other places to point website contributors in right direction
• ARROW-6230 - [R] Reading in Parquet files are 20x slower than reading fst files in R
• ARROW-6231 - [C++][Python] Consider assigning default column names when reading CSV file and header_rows=0
• ARROW-6232 - [C++] Rename Argsort kernel to SortToIndices
• ARROW-6237 - [R] Add option to set CXXFLAGS when compiling R package with $ARROW_R_CXXFLAGS
• ARROW-6240 - [Ruby] Arrow::Decimal128Array returns BigDecimal
• ARROW-6246 - [Website] Add link to R documentation site
• ARROW-6249 - [Java] Remove useless class ByteArrayWrapper
• ARROW-6252 - [Python] Add pyarrow.Array.diff method that exposes arrow::Diff
• ARROW-6253 - [Python] Expose "enable_buffered_stream" option from parquet::ReaderProperties in pyarrow.parquet.read_table
• ARROW-6258 - [R] Add macOS build scripts
• ARROW-6260 - [Website] Use deploy key on Travis to build and push to asf-site
• ARROW-6262 - [Developer] Show JIRA issue before merging
• ARROW-6264 - [Java] There is no need to consider byte order in ArrowBufHasher
• ARROW-6267 - [Ruby] Add Arrow::Time for Arrow::Time{32,64}DataType value
• ARROW-6271 - [Rust] [DataFusion] Add example for running SQL against Parquet
• ARROW-6272 - [Rust] [DataFusion] Add register_parquet convenience method to ExecutionContext
• ARROW-6279 - [Python] Add Table.slice method or allow slices in __getitem__
• ARROW-6284 - [C++] Allow references in std::tuple when converting tuple to arrow array
• ARROW-6289 - [Java] Add empty() in UnionVector to create instance
• ARROW-6294 - [C++] Use hyphen for plasma-store-server executable
• ARROW-6296 - [Java] Cleanup JDBC interfaces and eliminate one memcopy for binary/varchar fields
• ARROW-6297 - [Java] Compare ArrowBufPointers by unsinged integers
• ARROW-6303 - [Rust] Add a feature to disable SIMD
• ARROW-6304 - [Java] Add description to each maven artifact
• ARROW-6311 - [Java] Make ApproxEqualsVisitor accept DiffFunction to make it more flexible
• ARROW-6313 - [Format] Tracking for ensuring flatbuffer serialized values are aligned in stream/files.
• ARROW-6319 - [C++] Extract the core of NumericTensor::Value as Tensor::Value
• ARROW-6328 - Click.option-s should have help text
• ARROW-6329 - [Format] Add 4-byte "stream continuation" to IPC message format to align Flatbuffers
• ARROW-6331 - [Java] Incorporate ErrorProne into the java build
• ARROW-6334 - [Java] Improve the dictionary builder API to return the position of the value in the dictionary
• ARROW-6335 - [Java] Improve the performance of DictionaryHashTable
• ARROW-6336 - [Python] Clarify pyarrow.serialize/deserialize docstrings viz-a-viz relationship with Arrow IPC protocol
• ARROW-6337 - [R] as_tibble in R API is a misnomer
• ARROW-6338 - [R] Type function names don't match type names
• ARROW-6342 - [Python] Add pyarrow.record_batch factory function with same basic API / semantics as pyarrow.table
• ARROW-6350 - [Ruby] Remove Arrow::Struct and use Hash instead
• ARROW-6351 - [Ruby] Improve Arrow#values performance
• ARROW-6353 - [Python] Allow user to select compression level in pyarrow.parquet.write_table
• ARROW-6355 - [Java] Make range equal visitor reusable
• ARROW-6357 - [C++] S3: allow for background writes
• ARROW-6358 - [C++] FileSystem::DeleteDir should make it optional to delete the directory itself
• ARROW-6360 - [R] Update support for compression
• ARROW-6362 - [C++] S3: more flexible credential options
• ARROW-6365 - [R] Should be able to coerce numeric to integer with schema
• ARROW-6366 - [Java] Make field vectors final explicitly
• ARROW-6368 - [C++] Add RecordBatch projection functionality
• ARROW-6373 - [C++] Make FixedWidthBinaryBuilder consistent with other primitive fixed width builders
• ARROW-6375 - [C++] Extend ConversionTraits to allow efficiently appending list values in STL API
• ARROW-6379 - [C++] Do not append any buffers when serializing NullType for IPC
• ARROW-6381 - [C++] BufferOutputStream::Write is slow for many small writes
• ARROW-6384 - [C++] Bump dependencies
• ARROW-6391 - [Python][Flight] Add built-in methods on FlightServerBase to start server and wait for it to be available
• ARROW-6402 - [C++] Suppress sign-compare warning with g++ 9.2.1
• ARROW-6403 - [Python] Expose FileReader::ReadRowGroups() to Python
• ARROW-6408 - [Rust] Use "if cfg!" pattern in SIMD kernel implementations
• ARROW-6413 - [R] Support autogenerating column names
• ARROW-6415 - [R] Remove usage of R CMD config CXXCPP
• ARROW-6416 - [Python] Confusing API & documentation regarding chunksizes
• ARROW-6426 - [FlightRPC] Expose gRPC configuration knobs in Flight
• ARROW-6447 - [C++] Builds with ARROW_JEMALLOC=ON wait until jemalloc_ep is complete before building any libarrow .cc files
• ARROW-6450 - [C++] Use 2x reallocation strategy in arrow::BufferBuilder instead of 1.5x
• ARROW-6451 - [Format] Add clarifications to Columnar.rst about the contents of "null" slots in Varbinary or List arrays
• ARROW-6453 - [C++] More informative error messages from S3
• ARROW-6454 - [Developer] Add LLVM license to LICENSE.txt due to binary redistribution in packages
• ARROW-6458 - [Java] Remove value boxing/unboxing for ApproxEqualsVisitor
• ARROW-6462 - [C++] Can't build with bundled double-conversion on CentOS 6 x86_64
• ARROW-6465 - [Python] Improve Windows build instructions
• ARROW-6475 - [C++] Don't try to dictionary encode dictionary arrays
• ARROW-6477 - [Packaging][Crossbow] Use Azure Pipelines to build linux packages
• ARROW-6484 - [Java] Enable create indexType for DictionaryEncoding according to dictionary value count
• ARROW-6487 - [Rust] [DataFusion] Create test utils module
• ARROW-6489 - [Developer][Documentation] Fix merge script and readme
• ARROW-6504 - [Python][Packaging] Add mimalloc to conda packages for better performance
• ARROW-6505 - [Website] Add new committers
• ARROW-6518 - [Packaging][Python] Flight failing in OSX Python wheel builds
• ARROW-6524 - [Developer][Packaging] Nightly build report's subject should contain Arrow
• ARROW-6526 - [C++] Poison data in PoolBuffer destructor
• ARROW-6527 - [C++] Add OutputStream::Write() variant taking an owned buffer
• ARROW-6531 - [Python] Add detach() method to buffered streams
• ARROW-6532 - [R] Write parquet files with compression
• ARROW-6533 - [R] Compression codec should take a "level"
• ARROW-6534 - [Java] Fix typos and spelling
• ARROW-6540 - [R] Add Validate() methods
• ARROW-6541 - [Format][C++] Use two-part EOS and amend Format documentation
• ARROW-6542 - [R] Add View() method to array types
• ARROW-6544 - [R] Documentation/polishing for 0.15 release
• ARROW-6545 - [Go] Update Go IPC writer to use two-part EOS per mailing list discussion
• ARROW-6546 - [C++] Add missing FlatBuffers source dependency
• ARROW-6556 - [Python] Prepare for pandas release without SparseDataFrame
• ARROW-6557 - [Python] Always return pandas.Series from Array/ChunkedArray.to_pandas, propagate field names to Series from RecordBatch, Table
• ARROW-6558 - [C++] Refactor Iterator to a type erased handle
• ARROW-6559 - [Developer][C++] Add "archery" option to specify system toolchain for C++ builds
• ARROW-6569 - [Website] Add support for auto deployment by GitHub Actions
• ARROW-6570 - [Python] Use MemoryPool to allocate memory for NumPy arrays in to_pandas calls
• ARROW-6584 - [Python][Wheel] Bundle zlib again with the windows wheels
• ARROW-6588 - [C++] Suppress class-memaccess warning with g++ 9.2.1
• ARROW-6589 - [C++] Support BinaryType in MakeArrayOfNull
• ARROW-6590 - [C++] Do not require ARROW_JSON=ON when ARROW_IPC=ON
• ARROW-6591 - [R] Ignore .Rhistory files in source control
• ARROW-6605 - [C++] Add recursion depth control to fs::Selector
• ARROW-6606 - [C++] Construct tree structure from std::vectorfs::FileStats
• ARROW-6609 - [C++] Add minimal build Dockerfile example
• ARROW-6610 - [C++] Add ARROW_FILESYSTEM=ON/OFF CMake configuration flag
• ARROW-6621 - [Rust][DataFusion] Examples for DataFusion are not executed in CI
• ARROW-6629 - [Doc][C++] Document the FileSystem API
• ARROW-6630 - [Doc][C++] Document the file readers (CSV, JSON, Parquet, etc.)
• ARROW-6644 - [JS] Amend NullType IPC protocol to append no buffers
• ARROW-6647 - [C++] Can't build with g++ 4.8.5 on CentOS 7 by member initializer for shared_ptr
• ARROW-6649 - [R] print() methods for Table, RecordBatch, etc.
• ARROW-6653 - [Developer] Add support for auto JIRA link on pull request
• ARROW-6664 - [C++] Add option to build without SSE4.2
• ARROW-6667 - [Python] Avoid Reference Cycles in pyarrow.parquet
• ARROW-6683 - [Python] Add unit tests that validate cross-compatibility with pyarrow.parquet when fastparquet is installed
• ARROW-6735 - [C++] Suppress sign-compare warning with g++ 9.2.1

New Feature

• ARROW-1561 - [C++] Kernel implementations for "isin" (set containment)
• ARROW-1566 - [C++] Implement non-materializing sort kernels
• ARROW-1741 - [C++] Comparison function for DictionaryArray to determine if indices are "compatible"
• ARROW-3204 - [R] Enable package to be made available on CRAN
• ARROW-3777 - [C++] Implement a mock "high latency" filesystem
• ARROW-3817 - [R] $ method for RecordBatch
• ARROW-453 - [C++] Add filesystem implementation for Amazon S3
• ARROW-517 - [C++] Verbose Array::Equals
• ARROW-5351 - [Rust] Add support for take kernel functions
• ARROW-5588 - [C++] Better support for building UnionArrays
• ARROW-5594 - [C++] add support for UnionArrays to Take and Filter
• ARROW-5719 - [Java] Support in-place vector sorting
• ARROW-5792 - [Rust] [Parquet] A visitor trait for parquet types.
• ARROW-5832 - [Java] Support search operations for vector data
• ARROW-5834 - [Java] Apply new hash map in DictionaryEncoder
• ARROW-5835 - [Java] Support Dictionary Encoding for binary type
• ARROW-5844 - [Java] Support comparison & sort for more numeric types
• ARROW-5862 - [Java] Provide dictionary builder
• ARROW-5881 - [Java] Provide functionalities to efficiently determine if a validity buffer has completely 1 bits/0 bits
• ARROW-5892 - [C++][Gandiva] Support function aliases
• ARROW-5893 - [C++] Remove arrow::Column class from C++ library
• ARROW-5898 - [Java] Provide functionality to efficiently compute hash code for arbitrary memory segment
• ARROW-5901 - [Rust] Implement PartialEq to compare array and json values
• ARROW-5902 - [Java] Implement hash table and equals & hashCode API for dictionary encoding
• ARROW-5917 - [Java] Redesign the dictionary encoder
• ARROW-5920 - [Java] Support sort & compare for all variable width vectors
• ARROW-5945 - [Rust] [DataFusion] Table trait should support building complete queries
• ARROW-5970 - [Java] Provide pointer to Arrow buffer
• ARROW-5974 - [Python][C++] Enable CSV reader to read from concatenated gzip stream
• ARROW-5979 - [FlightRPC] Expose (de)serialization of protocol types
• ARROW-5997 - [Java] Support dictionary encoding for Union type
• ARROW-6013 - [Java] Support range searcher
• ARROW-6022 - [Java] Support equals API in ValueVector to compare two vectors equal
• ARROW-6024 - [Java] Provide more hash algorithms
• ARROW-6030 - [Java] Efficiently compute hash code for ArrowBufPointer
• ARROW-6031 - [Java] Support iterating a vector by ArrowBufPointer
• ARROW-6039 - [GLib] Add garrow_array_filter()
• ARROW-6053 - [Python] RecordBatchStreamReader::Open2 cdef type signature doesn't match C++
• ARROW-6079 - [Java] Implement/test UnionFixedSizeListWriter for FixedSizeListVector
• ARROW-6080 - [Java] Support compare and search operation for BaseRepeatedValueVector
• ARROW-6113 - [Java] Support vector deduplicate function
• ARROW-6138 - [C++] Add a basic (single RecordBatch) implementation of Dataset
• ARROW-6155 - [Java] Extract a super interface for vectors whose elements reside in continuous memory segments
• ARROW-6156 - [Java] Support compare semantics for ArrowBufPointer
• ARROW-6161 - [C++] Implements dataset::ParquetFile and associated Scan structures
• ARROW-6185 - [Java] Provide hash table based dictionary builder
• ARROW-6188 - [GLib] Add garrow_array_is_in()
• ARROW-6196 - [Ruby] Add support for building Arrow::TimeNNArray by .new
• ARROW-6197 - [GLib] Add garrow_decimal128_rescale()
• ARROW-6203 - [GLib] Add garrow_array_sort_to_indices()
• ARROW-6204 - [GLib] Add garrow_array_is_in_chunked_array()
• ARROW-6212 - [Java] Support vector rank operation
• ARROW-6229 - [C++] Add a DataSource implementation which scans a directory
• ARROW-6238 - [C++] Implement SimpleDataSource/SimpleDataFragment
• ARROW-6242 - [C++] Implements basic Dataset/Scanner/ScannerBuilder
• ARROW-6243 - [C++] Implement basic Filter expression classes
• ARROW-6244 - [C++] Implement Partition DataSource
• ARROW-6247 - [Java] Provide a common interface for float4 and float8 vectors
• ARROW-6250 - [Java] Implement ApproxEqualsVisitor comparing approx for floating point
• ARROW-6278 - [R] Read parquet files from raw vector
• ARROW-6288 - [Java] Implement TypeEqualsVisitor comparing vector type equals considering names and metadata
• ARROW-6306 - [Java] Support stable sort by stable comparators
• ARROW-6326 - [C++] Nullable fields when converting std::tuple to Table
• ARROW-6346 - [GLib] Add garrow_array_view()
• ARROW-6347 - [GLib] Add garrow_array_diff_unified()
• ARROW-6397 - [C++][CI] Fix S3 minio failure
• ARROW-6419 - [Website] Blog post about Parquet dictionary performance work coming in 0.15.x release
• ARROW-6427 - [GLib] Add support for column names autogeneration CSV read option
• ARROW-6438 - [R] Add bindings for filesystem API
• ARROW-6480 - [Developer] Add command to generate and send e-mail report for a Crossbow run
• ARROW-6675 - [JS] Add scanReverse function to dataFrame and filteredDataframe
• ARROW-750 - [Format] Add LargeBinary and LargeString types

Sub-task

• ARROW-4218 - [Rust] [Parquet] Implement ColumnReader
• ARROW-4365 - [Rust] [Parquet] Implement RecordReader
• ARROW-4507 - [Format] Create outline and introduction for new document.
• ARROW-4508 - [Format] Copy content from Layout.rst to new document.
• ARROW-4509 - [Format] Copy content from Metadata.rst to new document.
• ARROW-4510 - [Format] copy content from IPC.rst to new document.
• ARROW-4511 - [Format] remove individual documents in favor of new document once all content is moved
• ARROW-5846 - [Java] Create Avro adapter module and add dependencies
• ARROW-5861 - [Java] Initial implement to convert Avro record with primitive types
• ARROW-5988 - [Java] Avro adapter implement simple Record type
• ARROW-6035 - [Java] Avro adapter support convert nullable value
• ARROW-6069 - [Rust] [Parquet] Implement Converter to convert record reader to arrow primitive array.
• ARROW-6078 - [Java] Implement dictionary-encoded subfields for List type
• ARROW-6085 - [Rust] [DataFusion] Create traits for phsyical query plan
• ARROW-6086 - [Rust] [DataFusion] Implement parallel execution for parquet scan
• ARROW-6087 - [Rust] [DataFusion] Implement parallel execution for CSV scan
• ARROW-6088 - [Rust] [DataFusion] Implement parallel execution for projection
• ARROW-6089 - [Rust] [DataFusion] Implement parallel execution for selection
• ARROW-6090 - [Rust] [DataFusion] Implement parallel execution for hash aggregate
• ARROW-6097 - [Java] Avro adapter implement unions type
• ARROW-6101 - [Rust] [DataFusion] Create physical plan from logical plan
• ARROW-6199 - [Java] Avro adapter avoid potential resource leak.
• ARROW-6220 - [Java] Add API to avro adapter to limit number of rows returned at a time.
• ARROW-6265 - [Java] Avro adapter implement Array/Map/Fixed type
• ARROW-6287 - [Rust] [DataFusion] Refactor TableProvider to return thread-safe BatchIterator
• ARROW-6310 - [C++] Write 64-bit integers as strings in JSON integration test files
• ARROW-6314 - [C++] Implement changes to ensure flatbuffer alignment.
• ARROW-6315 - [Java] Make change to ensure flatbuffer reads are aligned
• ARROW-6316 - [Go] Make change to ensure flatbuffer reads are aligned
• ARROW-6317 - [JS] Implement changes to ensure flatbuffer alignment
• ARROW-6318 - [Integration] Update integration test to use generated binaries to ensure backwards compatibility
• ARROW-6356 - [Java] Avro adapter implement Enum type and nested Record type
• ARROW-6401 - [Java] Implement dictionary-encoded subfields for Struct type
• ARROW-6460 - [Java] Add benchmark and large fake data UT for avro adapter
• ARROW-6474 - [Python] Provide mechanism for python to write out old format
• ARROW-6519 - [Java] Use IPC continuation token to mark EOS
• ARROW-6539 - [R] Provide mechanism to write out old format
• ARROW-6563 - [Rust] [DataFusion] Create "merge" execution plan
• ARROW-6599 - [Rust] [DataFusion] Implement SUM aggregate expression
• ARROW-6665 - [Rust] [DataFusion] Implement numeric literal expressions
• ARROW-6668 - [Rust] [DataFusion] Implement CAST expression
• ARROW-6669 - [Rust] [DataFusion] Implement physical expression for binary expressions

Task

• ARROW-1875 - [Java] Write 64-bit ints as strings in integration test JSON files
• ARROW-2931 - [Crossbow] Windows builds are attempting to run linux and osx packaging tasks
• ARROW-5483 - [Java] add ValueVector constructors that take a Field object
• ARROW-5579 - [Java] shade flatbuffer dependency
• ARROW-5580 - [C++][Gandiva] Correct definitions of timestamp functions in Gandiva
• ARROW-5758 - [C++][Gandiva] Support casting decimals to varchar and vice versa
• ARROW-5841 - [Website] Add 0.14.0 release note
• ARROW-5867 - [C++][Gandiva] Add support for cast int to decimal
• ARROW-5872 - Support mod(double, double) method in Gandiva
• ARROW-5891 - [C++][Gandiva] Remove duplicates in function registries
• ARROW-5903 - [Java] Set methods in DecimalVector are slow
• ARROW-5934 - [Python] Bundle arrow's LICENSE with the wheels
• ARROW-5944 - [C++][Gandiva] Remove 'div' alias for 'divide'
• ARROW-5957 - [C++][Gandiva] Implement div function in Gandiva
• ARROW-5958 - [Python] Link zlib statically in the wheels
• ARROW-5975 - [C++][Gandiva] Add method to cast Date(in Milliseconds) to timestamp
• ARROW-6008 - [Release] Don't parallelize the bintray upload script
• ARROW-6009 - [Release][JS] Ignore NPM errors in the javascript release script
• ARROW-6023 - [C++][Gandiva] Add functions in Gandiva
• ARROW-6026 - [Doc] Add CONTRIBUTING.md
• ARROW-6034 - [C++][Gandiva] Add string functions in Gandiva
• ARROW-6094 - [Format][Flight] Add GetFlightSchema to Flight RPC
• ARROW-6134 - [C++][Gandiva] Add concat function in Gandiva
• ARROW-6137 - [C++][Gandiva] Change output format of castVARCHAR(timestamp) in Gandiva
• ARROW-6144 - [C++][Gandiva] Implement random function in Gandiva
• ARROW-6162 - [C++][Gandiva] Do not truncate string in castVARCHAR_varchar when out_len parameter is zero
• ARROW-6177 - [C++] Add Array::Validate()
• ARROW-6217 - [Website] Remove needless _site/ directory
• ARROW-6383 - [Java] report outstanding child allocators on parent allocator close
• ARROW-6385 - [C++] Investigate xxh3
• ARROW-6422 - [Gandiva] Fix double-conversion linker issue
• ARROW-6490 - [Java] log error for leak in allocator close
• ARROW-6491 - [Java] fix master build failure caused by ErrorProne
• ARROW-6601 - [Java] Improve JDBC adapter performance & add benchmark
• ARROW-6725 - [CI] Disable 3rdparty fuzzit nightly builds

Test

• ARROW-5525 - [C++][CI] Enable continuous fuzzing
• ARROW-5978 - [FlightRPC] [Java] Integration test client doesn't close buffers
• ARROW-6193 - [GLib] Add missing require in test
• ARROW-6218 - [Java] Add UINT type test in integration to avoid potential overflow

Wish

• ARROW-3538 - [Python] ability to override the automated assignment of uuid for filenames when writing datasets
• ARROW-6142 - [R] Install instructions on linux could be clearer
• ARROW-6183 - [R] Document that you don't have to use tidyselect if you don't want
• ARROW-6292 - [C++] Add an option to build with mimalloc
• ARROW-6300 - [C++] Add io::OutputStream::Abort()
• ARROW-6525 - [C++] CloseFromDestructor() should perhaps not crash
• ARROW-6549 - [C++] Switch back to latest jemalloc 5.x

Apache Arrow 0.14.0 (29 June 2019)

Bug

• ARROW-1837 - [Java] Unable to read unsigned integers outside signed range for bit width in integration tests
• ARROW-2119 - [C++][Java] Handle Arrow stream with zero record batch
• ARROW-2136 - [Python] Non-nullable schema fields not checked in conversions from pandas
• ARROW-2256 - [C++] Fuzzer builds fail out of the box on Ubuntu 16.04 using LLVM apt repos
• ARROW-2461 - [Python] Build wheels for manylinux2010 tag
• ARROW-3344 - [Python] test_plasma.py fails (in test_plasma_list)
• ARROW-3399 - [Python] Cannot serialize numpy matrix object
• ARROW-3650 - [Python] Mixed column indexes are read back as strings
• ARROW-3762 - [C++] Parquet arrow::Table reads error when overflowing capacity of BinaryArray
• ARROW-4021 - [Ruby] Error building red-arrow on msys2
• ARROW-4076 - [Python] schema validation and filters
• ARROW-4139 - [Python] Cast Parquet column statistics to unicode if UTF8 ConvertedType is set
• ARROW-4301 - [Java][Gandiva] Maven snapshot version update does not seem to update Gandiva submodule
• ARROW-4324 - [Python] Array dtype inference incorrect when created from list of mixed numpy scalars
• ARROW-4350 - [Python] dtype=object arrays cannot be converted to a list-of-list ListArray
• ARROW-4447 - [C++] Investigate dynamic linking for libthift
• ARROW-4516 - [Python] Error while creating a ParquetDataset on a path without `_common_dataset` but with an empty `_tempfile`
• ARROW-4651 - [Format] Flight Location should be more flexible than a (host, port) pair
• ARROW-4675 - [Python] Error serializing bool ndarray in py2 and deserializing in py3
• ARROW-4694 - [CI] detect-changes.py is inconsistent
• ARROW-4723 - [Python] Skip _files when reading a directory containing parquet files
• ARROW-4823 - [Python] read_csv shouldn't close file handles it doesn't own
• ARROW-4845 - [R] Compiler warnings on Windows MingW64
• ARROW-4851 - [Java] BoundsChecking.java defaulting behavior for old drill parameter seems off
• ARROW-4885 - [Python] read_csv() can't handle decimal128 columns
• ARROW-4886 - [Rust] Inconsistent behaviour with casting sliced primitive array to list array
• ARROW-4923 - Expose setters for Decimal vector that take long and double inputs
• ARROW-4934 - [Python] Address deprecation notice that will be a bug in Python 3.8
• ARROW-5019 - [C#] ArrowStreamWriter doesn't work on a non-seekable stream
• ARROW-5049 - [Python] org/apache/hadoop/fs/FileSystem class not found when pyarrow FileSystem used in spark
• ARROW-5051 - [GLib][Gandiva] Test failure in release verification script
• ARROW-5058 - [Release] 02-source.sh generates e-mail template with wrong links
• ARROW-5068 - [Gandiva][Packaging] Fix gandiva nightly builds after the CMake refactor
• ARROW-5090 - Parquet linking fails on MacOS due to @rpath in dylib
• ARROW-5092 - [C#] Source Link doesn't work with the C# release script
• ARROW-5095 - [Flight][C++] Flight DoGet doesn't expose server error message
• ARROW-5096 - [Packaging][deb] plasma-store-server packages are missing
• ARROW-5097 - [Packaging][CentOS6] arrow-lib has unresolvable dependencies
• ARROW-5098 - [Website] Update APT install document for 0.13.0
• ARROW-5100 - [JS] Writer swaps byte order if buffers share the same underlying ArrayBuffer
• ARROW-5117 - [Go] Panic when appending zero slices after initializing a builder
• ARROW-5119 - [Go] invalid Stringer implementation for array.Boolean
• ARROW-5129 - [Rust][Parquet] Column writer bug: check dictionary encoder when adding a new data page
• ARROW-5130 - [Python] Segfault when importing TensorFlow after Pyarrow
• ARROW-5132 - [Java] Errors on building gandiva_jni.dll on Windows with Visual Studio 2017
• ARROW-5138 - [Python/C++] Row group retrieval doesn't restore index properly
• ARROW-5142 - [CI] Fix conda calls in AppVeyor scripts
• ARROW-5144 - [Python] ParquetDataset and ParquetPiece not serializable
• ARROW-5146 - [Dev] Merge script imposes directory name
• ARROW-5147 - [C++] get an error in building: Could NOT find DoubleConversion
• ARROW-5148 - [CI] [C++] LLVM-related compile errors
• ARROW-5149 - [Packaging][Wheel] Pin LLVM to version 7 in windows builds
• ARROW-5152 - [Python] CMake warnings when building
• ARROW-5159 - Unable to build benches in arrow crate.
• ARROW-5160 - [C++] ABORT_NOT_OK evalutes expression twice
• ARROW-5166 - [Python][Parquet] Statistics for uint64 columns may overflow
• ARROW-5167 - [C++] Upgrade string-view-light to latest
• ARROW-5169 - [Python] non-nullable fields are converted to nullable in {{Table.from_pandas}}
• ARROW-5173 - [Go] handle multiple concatenated streams back-to-back
• ARROW-5174 - [Go] implement Stringer for DataTypes
• ARROW-5177 - [Python] ParquetReader.read_column() doesn't check bounds
• ARROW-5183 - [CI] MinGW build failures on AppVeyor
• ARROW-5184 - [Rust] Broken links and other documentation warnings
• ARROW-5195 - [Python] read_csv ignores null_values on string types
• ARROW-5201 - [Python] Import ABCs from collections is deprecated in Python 3.7
• ARROW-5208 - [Python] Inconsistent resulting type during casting in pa.array() when mask is present
• ARROW-5214 - [C++] Offline dependency downloader misses some libraries
• ARROW-5217 - [Rust] [CI] DataFusion test failure
• ARROW-5232 - [Java] value vector size increases rapidly in case of clear/setSafe loop
• ARROW-5233 - [Go] migrate to new flatbuffers-v1.11.0
• ARROW-5237 - [Python] pandas_version key in pandas metadata no longer populated
• ARROW-5240 - [C++][CI] cmake_format 0.5.0 appears to fail the build
• ARROW-5242 - [C++] Arrow doesn't compile cleanly with Visual Studio 2017 Update 9 or later due to narrowing
• ARROW-5243 - [Java][Gandiva] Add test for decimal compare functions
• ARROW-5245 - [C++][CI] Unpin cmake_format
• ARROW-5246 - [Go] use Go-1.12 in CI
• ARROW-5249 - [Java] Flight client doesn't handle auth correctly in some cases
• ARROW-5253 - [C++] external Snappy fails on Alpine
• ARROW-5254 - [Flight][Java] DoAction does not support result streams
• ARROW-5255 - [Java] Implement user-defined data types API
• ARROW-5260 - [Python][C++] Crash when deserializing from components in a fresh new process
• ARROW-5274 - [JavaScript] Wrong array type for countBy
• ARROW-5285 - [C++][Plasma] GpuProcessHandle is not released when GPU object deleted
• ARROW-5293 - [C++] Take kernel on DictionaryArray does not preserve ordered flag
• ARROW-5294 - [CI] setuptools_scm failures
• ARROW-5296 - [Java] Sporadic Flight test failures
• ARROW-5301 - [Python] parquet documentation outdated on nthreads argument
• ARROW-5306 - [CI] [GLib] Disable GTK-Doc
• ARROW-5308 - [Go] remove deprecated Feather format
• ARROW-5314 - [Go] Incorrect Printing for String Arrays with Offsets
• ARROW-5325 - [Archery][Benchmark] Output properly formatted jsonlines from benchmark diff cli command
• ARROW-5330 - [Python] [CI] Run Python Flight tests on Travis-CI
• ARROW-5332 - [R] R package fails to build/install: error in dyn.load()
• ARROW-5348 - [CI] [Java] Gandiva checkstyle failure
• ARROW-5360 - [Rust] Builds are broken by rustyline on nightly 2019-05-16+
• ARROW-5362 - [C++] Compression round trip test can cause some sanitizers to to fail
• ARROW-5373 - [Java] Add missing details for Gandiva Java Build
• ARROW-5376 - [C++] Compile failure on gcc 5.4.0
• ARROW-5383 - [Go] update IPC flatbuf (new Duration type)
• ARROW-5387 - [Go] properly handle sub-slice of List
• ARROW-5388 - [Go] use arrow.TypeEqual in array.NewChunked
• ARROW-5390 - [CI] Job time limit exceeded on Travis
• ARROW-5398 - [Python] Flight tests broken by URI changes
• ARROW-5403 - [C++] Test failures not propagated in Windows shared builds
• ARROW-5411 - [C++][Python] Build error building on Mac OS Mojave
• ARROW-5412 - [Java] Integration test fails with UnsupportedOperationException
• ARROW-5419 - [C++] CSV strings_can_be_null option doesn't respect all null_values
• ARROW-5421 - [Packaging][Crossbow] Duplicated key in nightly test configuration
• ARROW-5430 - [Python] Can read but not write parquet partitioned on large ints
• ARROW-5435 - [Java] add test for IntervalYearVector#getAsStringBuilder
• ARROW-5437 - [Python] Missing pandas pytest marker from parquet tests
• ARROW-5446 - [C++] Use cmake header install directory instead of include
• ARROW-5448 - [CI] MinGW build failures on AppVeyor
• ARROW-5453 - [C++] Just-released cmake-format 0.5.2 breaks the build
• ARROW-5455 - [Rust] Build broken by 2019-05-30 Rust nightly
• ARROW-5456 - [GLib][Plasma] Installed plasma-glib may be used on building document
• ARROW-5457 - [GLib][Plasma] Environment variable name for test is wrong
• ARROW-5459 - [Go] implement Stringer for Float16 DataType
• ARROW-5462 - [Go] support writing zero-length List
• ARROW-5487 - [CI] [Python] Failure in docs build
• ARROW-5507 - [Plasma] [CUDA] Compile error
• ARROW-5514 - [C++] Printer for uint64 shows wrong values
• ARROW-5517 - [C++] Header collection CMake logic should only consider filename without directory included
• ARROW-5520 - [C++][Packaging] No NVidia CUDA toolkit on AArch64C
• ARROW-5521 - [Packaging] License check fails with Apache RAT 0.13
• ARROW-5528 - Concatenate() crashes when concatenating empty binary arrays.
• ARROW-5532 - [JS] Field Metadata Not Read
• ARROW-5551 - [Go] invalid FixedSizeArray representation
• ARROW-5553 - [Ruby] red-arrow gem does not compile on ruby:2.5 docker image
• ARROW-5576 - [C++] Flaky thrift_ep tarball downloads
• ARROW-5577 - [C++] Link failure due to googletest shared library on Alpine Linux
• ARROW-5583 - [Java] When the isSet of a NullableValueHolder is 0, the buffer field should not be used
• ARROW-5584 - [Java] Add import for link reference in FieldReader javadoc
• ARROW-5589 - [C++][Fuzzing] arrow-ipc-fuzzing-test crash 2354085db0125113f04f7bd23f54b85cca104713
• ARROW-5592 - [Go] implement Duration array
• ARROW-5596 - [Python] Flight tests failing on Python 2.7
• ARROW-5601 - [gandiva] Error when projector with a string field
• ARROW-5603 - [Python] register pytest markers to avoid warnings
• ARROW-5605 - [C++][Fuzzing] arrow-ipc-fuzzing-test crash 74aec871d14bb6b07c72ea8f0e8c9f72cbe6b73c
• ARROW-5606 - [Python] pandas.RangeIndex._start/_stop/_step are deprecated
• ARROW-5608 - [C++][parquet] Invalid memory access when using parquet::arrow::ColumnReader
• ARROW-5615 - [C++] Compilation error due to C++11 string literals on gcc 5.4.0 Ubuntu 16.04
• ARROW-5616 - [Python] C++ build failure against Python 2.7 headers
• ARROW-5617 - [C++] thrift_ep 0.12.0 fails to build when using ARROW_BOOST_VENDORED=ON
• ARROW-5619 - [C++] get_apache_mirror.py doesn't work with Python 3.5
• ARROW-5624 - [C++] -Duriparser_SOURCE=BUNDLED is broken
• ARROW-5626 - [C++][Gandiva] Expression cache should consider precision and scale too
• ARROW-5629 - [C++] Fix Coverity issues
• ARROW-5631 - [C++] CMake 3.2 build is broken
• ARROW-5648 - [C++] Build fails on mingw without codecvt
• ARROW-5654 - [C++] ChunkedArray should validate the types of the arrays
• ARROW-5674 - [Python] Missing pandas pytest markers from test_parquet.py
• ARROW-5675 - [Doc] Fix typo in documentation describing compile/debug workflow on macOS with Xcode IDE
• ARROW-5678 - [R][Lint] Fix hadolint docker linting error
• ARROW-5693 - [Go] skip IPC integration test for Decimal128
• ARROW-5697 - [GLib] c_glib/Dockerfile is broken
• ARROW-5698 - [R] r/Dockerfile docker-compose build is broken
• ARROW-5709 - [C++] gandiva-date_time_test failure on Windows
• ARROW-5714 - [JS] Inconsistent behavior in Int64Builder with/without BigNum
• ARROW-5723 - [Gandiva][Crossbow] Builds failing
• ARROW-5728 - [Python] [CI] Travis-CI failures in test_jvm.py
• ARROW-5730 - [Python][CI] Selectively skip test cases in the dask integration test
• ARROW-5732 - [C++] macOS builds failing idiosyncratically on master with warnings from pmmintrin.h
• ARROW-5735 - [C++] Appveyor builds failing persistently in thrift_ep build
• ARROW-5737 - [C++][Gandiva] Gandiva not building in manylinux
• ARROW-5738 - [Crossbow][Conda] OSX package builds are failing with missing intrinsics
• ARROW-5739 - [CI] Fix docker python build
• ARROW-5750 - [Java] Java compilation failures on master
• ARROW-5754 - [C++]Missing override for ~GrpcStreamWriter?
• ARROW-5765 - [C++] TestDictionary.Validate test is crashed with release build
• ARROW-5770 - [C++] Fix -Wpessimizing-move in result.h
• ARROW-5771 - [Python] Docker python-nopandas job fails
• ARROW-5781 - [Archery] Ensure benchmark clone accepts remotes in revision
• ARROW-61 - [Java] Method can return the value bigger than long MAX_VALUE

Improvement

• ARROW-1496 - [JS] Upload coverage data to codecov.io
• ARROW-1957 - [Python] Write nanosecond timestamps using new NANO LogicalType Parquet unit
• ARROW-1983 - [Python] Add ability to write parquet `_metadata` file
• ARROW-2057 - [Python] Configure size of data pages in pyarrow.parquet.write_table
• ARROW-2217 - [C++] Add option to use dynamic linking for compression library dependencies
• ARROW-2298 - [Python] Add option to not consider NaN to be null when converting to an integer Arrow type
• ARROW-2707 - [C++] Implement Table::Slice methods using Column::Slice
• ARROW-2796 - [C++] Simplify symbols.map file, use when building libarrow_python
• ARROW-2818 - [Python] Better error message when passing SparseDataFrame into Table.from_pandas
• ARROW-2981 - [C++] Support scripts / documentation for running clang-tidy on codebase
• ARROW-3040 - [Go] add support for comparing Arrays
• ARROW-3041 - [Go] add support for TimeArray
• ARROW-3052 - [C++] Detect ORC system packages
• ARROW-3144 - [C++] Move "dictionary" member from DictionaryType to ArrayData to allow for changing dictionaries between Array chunks
• ARROW-3150 - [Python] Ship Flight-enabled Python wheels on Linux and Windows
• ARROW-3166 - [C++] Consolidate IO interfaces used in arrow/io and parquet-cpp
• ARROW-3200 - [C++] Add support for reading Flight streams with dictionaries
• ARROW-3290 - [C++] Toolchain support for secure gRPC
• ARROW-3294 - [C++] Test Flight RPC on Windows / Appveyor
• ARROW-3314 - [R] Set -rpath using pkg-config when building
• ARROW-3475 - [C++] Int64Builder.Finish(NumericArray)
• ARROW-3572 - [Packaging] Correctly handle ssh origin urls for crossbow
• ARROW-3671 - [Go] implement Interval array
• ARROW-3676 - [Go] implement Decimal128 array
• ARROW-3679 - [Go] implement IPC protocol
• ARROW-3680 - [Go] implement Float16 array
• ARROW-3686 - [Python] Support for masked arrays in to/from numpy
• ARROW-3729 - [C++] Support for writing TIMESTAMP_NANOS Parquet metadata
• ARROW-3758 - [R] Build R library on Windows, document build instructions for Windows developers
• ARROW-3759 - [R][CI] Build and test on Windows in Appveyor
• ARROW-3767 - [C++] Add cast for Null to any type
• ARROW-3780 - [R] Failed to fetch data: invalid data when collecting int16
• ARROW-3794 - [R] Consider mapping INT8 to integer() not raw()
• ARROW-3804 - [R] Consider lowering required R runtime
• ARROW-3904 - [C++/Python] Validate scale and precision of decimal128 type
• ARROW-4013 - [Documentation][C++] Document how to build Apache Arrow on MSYS2
• ARROW-4020 - [Release] Remove source artifacts from dev dist system after release vote passes
• ARROW-4047 - [Python] Document use of int96 timestamps and options in Parquet docs
• ARROW-4159 - [C++] Check for -Wdocumentation issues
• ARROW-4194 - [Format] Metadata.rst does not specify timezone for Timestamp type
• ARROW-4337 - [C#] Array / RecordBatch Builder Fluent API
• ARROW-4343 - [C++] Add as complete as possible Ubuntu Trusty / 14.04 build to docker-compose setup
• ARROW-4356 - [CI] Add integration (docker) test for turbodbc
• ARROW-4452 - [Python] Serializing sparse torch tensors
• ARROW-4467 - [Rust] [DataFusion] Create a REPL & Dockerfile for DataFusion
• ARROW-4503 - [C#] ArrowStreamReader allocates and copies data excessively
• ARROW-4504 - [C++] Reduce the number of unit test executables
• ARROW-4505 - [C++] Nicer PrettyPrint for date32
• ARROW-4566 - [C++][Flight] Add option to run arrow-flight-benchmark against a perf server running on a different host
• ARROW-4596 - [Rust] [DataFusion] Implement COUNT aggregate function
• ARROW-4622 - [C++] [Python] MakeDense and MakeSparse in UnionArray should accept a vector of Field
• ARROW-4625 - [Flight] Wrap server busy-wait methods
• ARROW-4626 - [Flight] Add application metadata field to DoGet
• ARROW-4627 - [Flight] Add application metadata field to DoPut
• ARROW-4714 - [C++][Java] Providing JNI interface to Read ORC file via Arrow C++
• ARROW-4717 - [C#] Consider exposing ValueTask instead of Task
• ARROW-4787 - [C++] Include "null" values (perhaps with an option to toggle on/off) in hash kernel actions
• ARROW-4788 - [C++] Develop less verbose API for constructing StructArray
• ARROW-4800 - [C++] Create/port a StatusOr implementation to be able to return a status or a type
• ARROW-4824 - [Python] read_csv should accept io.StringIO objects
• ARROW-4847 - [Python] Add pyarrow.table factory function that dispatches to various ctors based on type of input
• ARROW-4911 - [R] Support for building package for Windows
• ARROW-4912 - [C++, Python] Allow specifying column names to CSV reader
• ARROW-4945 - [Flight] Enable Flight integration tests in Travis
• ARROW-4968 - [Rust] StructArray builder and From<> methods should check that field types match schema
• ARROW-4990 - [C++] Kernel to compare array with array
• ARROW-4993 - [C++] Display summary at the end of CMake configuration
• ARROW-5000 - [Python] Fix deprecation warning from setup.py
• ARROW-5007 - [C++] Move DCHECK out of sse-utils
• ARROW-5020 - [C++][Gandiva] Split Gandiva-related conda packages for builds into separate .yml conda env file
• ARROW-5027 - [Python] Add JSON Reader
• ARROW-5038 - [Rust] [DataFusion] Implement AVG aggregate function
• ARROW-5039 - [Rust] [DataFusion] Fix bugs in CAST support
• ARROW-5045 - [Rust] Code coverage silently failing in CI
• ARROW-5053 - [Rust] [DataFusion] Use env var for location of arrow test data
• ARROW-5054 - [C++][Release] Test Flight in verify-release-candidate.sh
• ARROW-5061 - [Release] Improve 03-binary performance
• ARROW-5062 - [Java] Shade Java Guava dependency for Flight
• ARROW-5063 - [Java] FlightClient should not create a child allocator
• ARROW-5064 - [Release] Pass PKG_CONFIG_PATH to glib in the verification script
• ARROW-5066 - [Integration] Add flags to enable/disable implementations in integration/integration_test.py
• ARROW-5076 - [Packaging] Improve post binary upload performance
• ARROW-5077 - [Rust] Release process should change Cargo.toml to use release versions
• ARROW-5078 - [Documentation] Sphinx is failed by RemovedInSphinx30Warning
• ARROW-5079 - [Release] Add a script to release C# package
• ARROW-5080 - [Release] Add a script to release Rust packages
• ARROW-5081 - [C++] Consistently use PATH_SUFFIXES in CMake config
• ARROW-5082 - [Python][Packaging] Reduce size of macOS and manylinux1 wheels
• ARROW-5083 - [Developer] In merge_arrow_pr.py script, allow user to set a released Fix Version
• ARROW-5088 - [C++] Do not set -Werror when using BUILD_WARNING_LEVEL=CHECKIN in release mode
• ARROW-5091 - [Flight] Rename FlightGetInfo message to FlightInfo
• ARROW-5093 - [Packaging] Add support for selective binary upload
• ARROW-5094 - [Packaging] Add APT/Yum verification scripts
• ARROW-5113 - [C++][Flight] Unit tests in C++ for DoPut
• ARROW-5116 - [Rust] move kernel related files under compute/kernels
• ARROW-5124 - [C++] Add support for Parquet in MinGW build
• ARROW-5136 - [Flight] Implement call options (timeouts)
• ARROW-5137 - [Flight] Implement authentication APIs
• ARROW-5157 - [Website] Add MATLAB to powered by Apache Arrow page
• ARROW-5162 - [Rust] [Parquet] Rename mod reader to arrow.
• ARROW-5163 - [Gandiva] Cast timestamp/date are incorrectly evaluating year 0097 to 1997
• ARROW-5165 - [Python][Documentation] Build docs don't suggest assigning $ARROW_BUILD_TYPE
• ARROW-5178 - [Python] Allow creating Table from Python dict
• ARROW-5179 - [Python] Return plain dicts, not OrderedDict, on Python 3.7+
• ARROW-5185 - [C++] Add support for Boost with CMake configuration file
• ARROW-5191 - [Rust] Expose CSV and JSON reader schemas
• ARROW-5204 - [C++] Improve BufferBuilder performance
• ARROW-5212 - [Go] Array BinaryBuilder in Go library has no access to resize the values buffer
• ARROW-5218 - [C++] Improve build when third-party library locations are specified
• ARROW-5219 - [C++] Build protobuf_ep in parallel when using Ninja
• ARROW-5222 - [Python] Issues with installing pyarrow for development on MacOS
• ARROW-5225 - [Java] Improve performance of BaseValueVector#getValidityBufferSizeFromCount
• ARROW-5238 - [Python] Improve usability of pyarrow.dictionary function
• ARROW-5241 - [Python] Add option to disable writing statistics to parquet file
• ARROW-5252 - [C++] Change variant implementation
• ARROW-5256 - [Packaging][deb] Failed to build with LLVM 7.1.0
• ARROW-5257 - [Website] Update site to use "official" Apache Arrow logo, add clearly marked links to logo
• ARROW-5258 - [C++/Python] Expose file metadata of dataset pieces to caller
• ARROW-5261 - [C++] Finish implementation of scalar types for Duration and Interval
• ARROW-5262 - [Python] Fix typo
• ARROW-5264 - [Java] Allow enabling/disabling boundary checking by environmental variable
• ARROW-5269 - [C++] Whitelist benchmarks candidates for regression checks
• ARROW-5281 - [Rust] [Parquet] Move DataPageBuilder to test_common
• ARROW-5284 - [Rust] Replace libc with std::alloc for memory allocation
• ARROW-5286 - [Python] support Structs in Table.from_pandas given a known schema
• ARROW-5288 - [Documentation] Enrich the contribution guidelines
• ARROW-5289 - [C++] Move arrow/util/concatenate.h to arrow/array/
• ARROW-5291 - [Python] Add wrapper for "take" kernel on Array
• ARROW-5298 - [Rust] Add debug implementation for Buffer
• ARROW-5309 - [Python] Add clarifications to Python "append" methods that return new objects
• ARROW-5311 - [C++] Return more specific invalid Status in Take kernel
• ARROW-5317 - [Rust] [Parquet] impl IntoIterator for SerializedFileReader
• ARROW-5319 - [CI] Enable ccache with MinGW builds
• ARROW-5323 - [CI] Use compression with clcache
• ARROW-5328 - [R] Add shell scripts to do a full package rebuild and test locally
• ARROW-5334 - [C++] Add "Type" to names of arrow::Integer, arrow::FloatingPoint classes for consistency
• ARROW-5335 - [Python] Raise on variable dictionaries when converting to pandas
• ARROW-5339 - [C++] Add jemalloc to thirdparty dependency download script
• ARROW-5341 - [C++] Add instructions about fixing and testing for -Wdocumentation clang warnings locally
• ARROW-5349 - [Python/C++] Provide a way to specify the file path in parquet ColumnChunkMetaData
• ARROW-5361 - [R] Follow DictionaryType/DictionaryArray changes from ARROW-3144
• ARROW-5363 - [GLib] Fix coding styles
• ARROW-5364 - [C++] Use ASCII rather than UTF-8 in BuildUtils.cmake comment
• ARROW-5365 - [C++][CI] Add UBSan and ASAN into CI
• ARROW-5368 - [C++] Disable jemalloc by default with MinGW
• ARROW-5369 - [C++] Add support for glog on Windows
• ARROW-5370 - [C++] Detect system uriparser by default
• ARROW-5378 - [C++] Add local FileSystem implementation
• ARROW-5389 - [C++] Add an internal temporary directory API
• ARROW-5393 - [R] Add tests and example for read_parquet()
• ARROW-5395 - [C++] Utilize stream EOS in File format
• ARROW-5407 - [C++] Integration test Travis CI entry builds many unnecessary targets
• ARROW-5413 - [C++] CSV reader doesn't remove BOM
• ARROW-5415 - [Release] Release script should update R version everywhere
• ARROW-5416 - [Website] Add Homebrew to project installation page
• ARROW-5418 - [CI][R] Run code coverage and report to codecov.io
• ARROW-5420 - [Java] Implement or remove getCurrentSizeInBytes in VariableWidthVector
• ARROW-5427 - [Python] RangeIndex serialization change implications
• ARROW-5428 - [C++] Add option to set "read extent" in arrow::io::BufferedInputStream
• ARROW-5429 - [Java] Provide alternative buffer allocation policy
• ARROW-5433 - [C++][Parquet] improve parquet-reader columns information
• ARROW-5436 - [Python] expose filters argument in parquet.read_table
• ARROW-5438 - [JS] Utilize stream EOS in File format
• ARROW-5441 - [C++] Implement FindArrowFlight.cmake
• ARROW-5442 - [Website] Clarify what makes a release artifact "official"
• ARROW-5447 - [CI] [Ruby] CI is failed on AppVeyor
• ARROW-5452 - [R] Add documentation website (pkgdown)
• ARROW-5461 - [Java] Add micro-benchmarks for Float8Vector and allocators
• ARROW-5464 - [Archery] Bad --benchmark-filter default
• ARROW-5465 - [Crossbow] Support writing submitted job definition yaml to a file
• ARROW-5470 - [CI] C++ local filesystem patch breaks Travis R job
• ARROW-5472 - [Development] Add warning to PR merge tool if no JIRA component is set
• ARROW-5474 - [C++] Document required Boost version
• ARROW-5477 - [C++] Check required RapidJSON version
• ARROW-5478 - [Packaging] Drop Ubuntu 14.04 support
• ARROW-5481 - [GLib] garrow_seekable_input_stream_peek() misses "error" parameter document
• ARROW-5488 - [R] Workaround when C++ lib not available
• ARROW-5492 - [R] Add "col_select" argument to read_* functions to read subset of columns
• ARROW-5495 - [C++] Use HTTPS consistently for downloading dependencies
• ARROW-5496 - [R][CI] Fix relative paths in R codecov.io reporting
• ARROW-5498 - [C++] Build failure with Flatbuffers 1.11.0 and MinGW
• ARROW-5500 - [R] read_csv_arrow() signature should match readr::read_csv()
• ARROW-5503 - [R] add read_json()
• ARROW-5504 - [R] move use_threads argument to global option
• ARROW-5509 - [R] write_parquet()
• ARROW-5511 - [Packaging] Enable Flight in Conda packages
• ARROW-5513 - [Java] Refactor method name for getstartOffset to use camel case
• ARROW-5516 - [Python] Development page for pyarrow has a missing dependency in using pip
• ARROW-5518 - [Java] Set VectorSchemaRoot rowCount to 0 on allocateNew and clear
• ARROW-5524 - [C++] Turn off PARQUET_BUILD_ENCRYPTION in CMake if OpenSSL not found
• ARROW-5526 - [Developer] Add more prominent notice to GitHub issue template to direct bug reports to JIRA
• ARROW-5529 - [Flight] Allow serving with multiple TLS certificates
• ARROW-5531 - [Python] Support binary, utf8, and nested types in Array.from_buffers
• ARROW-5533 - [Plasma] Plasma client should be thread-safe
• ARROW-5538 - [C++] Restrict minimum OpenSSL version to 1.0.2
• ARROW-5541 - [R] cast from negative int32 to uint32 and uint64 are now safe
• ARROW-5544 - [Archery] should not return non-zero in `benchmark diff` sub command on regression
• ARROW-5545 - [C++][Docs] Clarify expectation of UTC values for timestamps with time zones in C++ API docs
• ARROW-5547 - [C++][FlightRPC] arrow-flight.pc isn't provided
• ARROW-5552 - [Go] make Schema and Field implement Stringer
• ARROW-5554 - Add a python wrapper for arrow::Concatenate
• ARROW-5555 - [R] Add install_arrow() function to assist the user in obtaining C++ runtime libraries
• ARROW-5556 - [Doc] Document JSON reader
• ARROW-5565 - [Python] Document how to use gdb when working on pyarrow
• ARROW-5567 - [C++] Fix build error of memory-benchmark
• ARROW-5574 - [R] documentation error for read_arrow()
• ARROW-5582 - [Go] add support for comparing Records
• ARROW-5586 - [R] convert Array of LIST type to R lists
• ARROW-5587 - [Java] Add more maven style check for Java code
• ARROW-5590 - [R] Run "no libarrow" R build in the same CI entry if possible
• ARROW-5600 - [R] R package namespace cleanup
• ARROW-5604 - [Go] improve test coverage of type-traits
• ARROW-5612 - [Python][Documentation] Clarify date_as_object option behavior
• ARROW-5622 - [C++][Dataset] arrow-dataset.pc isn't provided
• ARROW-5625 - [R] convert Array of struct type to data frame columns
• ARROW-5632 - [Doc] Add some documentation describing compile/debug workflow on macOS with Xcode IDE
• ARROW-5633 - [Python] Enable bz2 in Linux wheels
• ARROW-5635 - [C++] Support "compacting" a table
• ARROW-5639 - [Java] Remove floating point computation from getOffsetBufferValueCapacity
• ARROW-5641 - [GLib] Remove enums files generated by GNU Autotools from Git targets
• ARROW-5643 - [Flight] Add ability to override hostname checking
• ARROW-5652 - [CI] Fix iwyu docker image
• ARROW-5656 - [Python] Enable Flight wheels on macOS
• ARROW-5659 - [C++] Add support for finding OpenSSL installed by Homebrew
• ARROW-5660 - [GLib][CI] Use the latest macOS image and all Homebrew based libraries
• ARROW-5662 - [C++] Add support for BOOST_SOURCE=AUTO|BUNDLED|SYSTEM
• ARROW-5663 - [Packaging][RPM] Update CentOS packages for 0.14.0
• ARROW-5664 - [Crossbow] Execute nightly crossbow tests on CircleCI instead of Travis
• ARROW-5668 - [Python] Display "not null" in Schema.__repr__ for non-nullable fields
• ARROW-5669 - [Crossbow] manylinux1 wheel building failing
• ARROW-5670 - [Crossbow] get_apache_mirror.py fails with TLS error on macOS with Python 3.5
• ARROW-5671 - [crossbow] mac os python wheels failing
• ARROW-5683 - [R] Add snappy to Rtools Windows builds
• ARROW-5684 - [Packaging][deb] Add support for Ubuntu 19.04
• ARROW-5685 - [Packaging][deb] Add support for Apache Arrow Datasets
• ARROW-5687 - [C++] Remove remaining uses of ARROW_BOOST_VENDORED
• ARROW-5690 - [Packaging][Python] macOS wheels broken: libprotobuf.18.dylib missing
• ARROW-5694 - [Python] List of decimals are not supported when converting to pandas
• ARROW-5695 - [C#][Release] Run sourcelink test in verify-release-candidate.sh
• ARROW-5699 - [C++] Optimize parsing of Decimal128 in CSV
• ARROW-5702 - [C++] parquet::arrow::FileReader::GetSchema()
• ARROW-5705 - [Java] Optimize BaseValueVector#computeCombinedBufferSize logic
• ARROW-5706 - [Java] Remove type conversion in getValidityBufferValueCapacity
• ARROW-5707 - [Java] Improve the performance and code structure for ArrowRecordBatch
• ARROW-5710 - [C++] Allow compiling Gandiva with Ninja on Windows
• ARROW-5718 - [R] auto splice data frames in record_batch() and table()
• ARROW-5721 - [Rust] Move array related code into a separate module
• ARROW-5724 - [R] [CI] AppVeyor build should use ccache
• ARROW-5725 - [Crossbow] Port conda recipes to azure pipelines
• ARROW-5727 - [Python] [CI] Install pytest-faulthandler before running tests
• ARROW-5748 - [Packaging][deb] Add support for Debian GNU/Linux buster
• ARROW-5749 - [Python] Add Python binding for Table::CombineChunks()
• ARROW-5751 - [Packaging][Python] Python macOS wheels have dynamic dependency on libcares
• ARROW-5752 - [Java] Improve the performance of ArrowBuf#setZero
• ARROW-5768 - [Release] There are needless newlines at the end of CHANGELOG.md
• ARROW-5773 - [R] Clean up documentation before release
• ARROW-5782 - [Release] Setup test data for Flight in dev/release/01-perform.sh
• ARROW-5783 - [Release][C#] Exclude dummy.git from RAT check
• ARROW-767 - [C++] Adopt FileSystem abstraction
• ARROW-835 - [Format] Add Timedelta type to describe time intervals

New Feature

• ARROW-1012 - [C++] Create a configurable implementation of RecordBatchReader that reads from Apache Parquet files
• ARROW-1207 - [C++] Implement Map logical type
• ARROW-1261 - [Java] Add container type for Map logical type
• ARROW-1278 - Integration tests for Fixed Size List type
• ARROW-1279 - [Integration][Java] Integration tests for Map type
• ARROW-1280 - [C++] Implement Fixed Size List type
• ARROW-1558 - [C++] Implement boolean selection kernels
• ARROW-1774 - [C++] Add "view" function to create zero-copy views for compatible types, if supported
• ARROW-2467 - [Rust] Generate code using Flatbuffers
• ARROW-2517 - [Java] Add list writer
• ARROW-2835 - [C++] ReadAt/WriteAt are inconsistent with moving the files position
• ARROW-2969 - [R] Convert between StructArray and "nested" data.frame column containing data frame in each cell
• ARROW-3087 - [C++] Add kernels for comparison operations to scalars
• ARROW-3191 - [Java] Add support for ArrowBuf to point to arbitrary memory.
• ARROW-3419 - [C++] Run include-what-you-use checks as nightly build
• ARROW-3732 - [R] Add functions to write RecordBatch or Schema to Message value, then read back
• ARROW-3791 - [C++] Add type inference for boolean values in CSV files
• ARROW-3810 - [R] type= argument for Array and ChunkedArray
• ARROW-3811 - [R] struct arrays inference
• ARROW-3814 - [R] RecordBatch$from_arrays()
• ARROW-3815 - [R] refine record batch factory
• ARROW-3848 - [R] allow nbytes to be missing in RandomAccessFile$Read()
• ARROW-3897 - [MATLAB] Add MATLAB support for writing numeric datatypes to a Feather file
• ARROW-4302 - [C++] Add OpenSSL to C++ build toolchain
• ARROW-4701 - [C++] Add JSON chunker benchmarks
• ARROW-4708 - [C++] Add multithreaded JSON reader
• ARROW-4741 - [Java] Add documentation to all classes and enable checkstyle for class javadocs
• ARROW-4805 - [Rust] Write temporal arrays to CSV
• ARROW-4806 - [Rust] Support casting temporal arrays in cast kernels
• ARROW-4827 - [C++] Implement benchmark comparison between two git revisions
• ARROW-5071 - [Benchmarking] Performs a benchmark run with archery
• ARROW-5115 - [JS] Implement the Vector Builders
• ARROW-5126 - [Rust] [Parquet] Convert parquet column desc to arrow data type
• ARROW-5150 - [Ruby] Add Arrow::Table#raw_records
• ARROW-5155 - [GLib][Ruby] Add support for building union arrays from data type
• ARROW-5168 - [GLib] Add garrow_array_take()
• ARROW-5171 - [C++] Use LESS instead of LOWER in compare enum option.
• ARROW-5187 - [Rust] Ability to flatten StructArray into a RecordBatch
• ARROW-5188 - [Rust] Add temporal builders for StructArray
• ARROW-5189 - [Rust] [Parquet] Format individual fields within a parquet row
• ARROW-5203 - [GLib] Add support for Compare filter
• ARROW-5268 - [GLib] Add GArrowJSONReader
• ARROW-5290 - [Java] Provide a flag to enable/disable null-checking in vectors' get methods
• ARROW-5299 - [C++] ListArray comparison is incorrect
• ARROW-5329 - Add support for building MATLAB interface to Feather directly within MATLAB
• ARROW-5342 - [Format] Formalize extension type metadata in IPC protocol
• ARROW-5372 - [GLib] Add support for null/boolean values CSV read option
• ARROW-5384 - [Go] add FixedSizeList array
• ARROW-5396 - [JS] Ensure reader and writer support files and streams with no RecordBatches
• ARROW-5404 - [C++] nonstd::string_view conflicts with std::string_view in c++17
• ARROW-5432 - [Python] Add 'read_at' method to pyarrow.NativeFile
• ARROW-5463 - [Rust] Implement AsRef for Buffer
• ARROW-5486 - [GLib] Add binding of gandiva::FunctionRegistry and related things
• ARROW-5512 - [C++] Draft initial public APIs for Datasets project
• ARROW-5534 - [GLib] Add garrow_table_concatenate()
• ARROW-5535 - [GLib] Add garrow_table_slice()
• ARROW-5537 - [JS] Support delta dictionaries in RecordBatchWriter and DictionaryBuilder
• ARROW-5581 - [Java] Provide interfaces and initial implementations for vector sorting
• ARROW-5597 - [Packaging][deb] Add Flight packages
• ARROW-5755 - [Rust] [Parquet] Add derived clone for Type
• ARROW-653 - [Python / C++] Add debugging function to print an array's buffer contents in hexadecimal
• ARROW-840 - [Python] Provide Python API for creating user-defined data types that can survive Arrow IPC
• ARROW-973 - [Website] Add FAQ page about project

Sub-task

• ARROW-2102 - [C++] Implement take kernel functions - primitive value type
• ARROW-2103 - [C++] Implement take kernel functions - string/binary value type
• ARROW-2104 - [C++] Implement take kernel functions - nested array value type
• ARROW-2105 - [C++] Implement take kernel functions - properly handle special indices
• ARROW-4121 - [C++] Refactor memory allocation from InvertKernel
• ARROW-4971 - [Go] DataType equality
• ARROW-4972 - [Go] Array equality
• ARROW-4973 - [Go] Slice Array equality
• ARROW-4974 - [Go] Array approx equality
• ARROW-5108 - [Go] implement reading primitive arrays from Arrow file
• ARROW-5109 - [Go] implement reading binary/string arrays from Arrow file
• ARROW-5110 - [Go] implement reading struct arrays from Arrow file
• ARROW-5111 - [Go] implement reading list arrays from Arrow file
• ARROW-5112 - [Go] implement writing arrays to Arrow file
• ARROW-5127 - [Rust] [Parquet] Add page iterator
• ARROW-5172 - [Go] implement reading fixed-size binary arrays from Arrow file
• ARROW-5250 - [Java] remove javadoc suppression on methods.
• ARROW-5266 - [Go] implement read/write IPC for Float16
• ARROW-5392 - [C++][CI][MinGW] Disable static library build on AppVeyor
• ARROW-5467 - [Go] implement read/write IPC for Time32/Time64 arrays
• ARROW-5468 - [Go] implement read/write IPC for Timestamp arrays
• ARROW-5469 - [Go] implement read/write IPC for Date32/Date64 arrays
• ARROW-5591 - [Go] implement read/write IPC for Duration & Intervals
• ARROW-5621 - [Go] implement read/write IPC for Decimal128 arrays
• ARROW-5672 - [Java] Refactor redundant method modifier
• ARROW-5780 - [C++] Add benchmark for Decimal128 operations

Task

• ARROW-2412 - [Integration] Add nested dictionary integration test
• ARROW-4086 - [Java] Add apis to debug alloc failures
• ARROW-4702 - [C++] Upgrade dependency versions
• ARROW-4719 - [C#] Implement ChunkedArray, Column and Table in C#
• ARROW-4904 - [C++] Move implementations in arrow/ipc/test-common.h into libarrow_testing
• ARROW-4913 - [Java][Memory] Limit number of ledgers and arrowbufs
• ARROW-4956 - [C#] Allow ArrowBuffers to wrap external Memory in C#
• ARROW-4959 - [Gandiva][Crossbow] Builds broken
• ARROW-5056 - [Packaging] Adjust conda recipes to use ORC conda-forge package on unix systems
• ARROW-5164 - [Gandiva] [C++] Introduce 32bit hash functions
• ARROW-5226 - [Gandiva] support compare operators for decimal
• ARROW-5275 - [C++] Write generic filesystem tests
• ARROW-5313 - [Format] Comments on Field table are a bit confusing
• ARROW-5321 - [Gandiva][C++] add isnull and isnotnull for utf8 and binary types
• ARROW-5346 - [C++] Revert changes to qualify duration in vendored date code
• ARROW-5434 - [Java] Introduce wrappers for backward compatibility for ArrowBuf changes in ARROW-3191
• ARROW-5443 - [Gandiva][Crossbow] Turn parquet encryption off
• ARROW-5449 - [C++] Local filesystem implementation: investigate Windows UNC paths
• ARROW-5451 - [C++][Gandiva] Add round functions for decimals
• ARROW-5476 - [Java][Memory] Fix Netty ArrowBuf Slice
• ARROW-5485 - [Gandiva][Crossbow] OSx builds failing
• ARROW-5490 - [C++] Remove ARROW_BOOST_HEADER_ONLY
• ARROW-5491 - [C++] Remove unecessary semicolons following MACRO definitions
• ARROW-5557 - [C++] Investigate performance of VisitBitsUnrolled on different platforms
• ARROW-5580 - Correct definitions of timestamp functions in Gandiva
• ARROW-5602 - [Java][Gandiva] Add test for decimal round functions
• ARROW-5637 - [Gandiva] [Java]Complete IN Expression
• ARROW-5650 - [Python] Update manylinux dependency versions
• ARROW-5661 - Support hash functions for decimal in Gandiva
• ARROW-5696 - [Gandiva] [C++] Introduce castVarcharVarchar
• ARROW-5701 - [C++][Gandiva] Build expressions only for the required selection vector types
• ARROW-5704 - [C++] Stop using ARROW_TEMPLATE_EXPORT for SparseTensorImpl class

Test

• ARROW-4523 - [JS] Add row proxy generation benchmark
• ARROW-4725 - [C++] Dictionary tests disabled under MinGW builds
• ARROW-5194 - [C++][Plasma] TEST(PlasmaSerialization, GetReply) is failing
• ARROW-5371 - [Release] Add tests for dev/release/00-prepare.sh
• ARROW-5397 - Test Flight TLS support
• ARROW-5479 - [Rust] [DataFusion] Use ARROW_TEST_DATA instead of relative path for testing
• ARROW-5493 - [Integration/Go] add Go support for IPC integration tests
• ARROW-5623 - [CI][GLib] Failed on macOS
• ARROW-5769 - [Java] org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh

Wish

• ARROW-5102 - [C++] Reduce header dependencies
• ARROW-5145 - [C++] Release mode lacks convenience input validation
• ARROW-5190 - [R] Discussion: tibble dependency in R package
• ARROW-5401 - [CI] [C++] Print ccache statistics on Travis-CI

Apache Arrow 0.13.0 (28 March 2019)

Bug

• ARROW-2392 - [Python] pyarrow RecordBatchStreamWriter allows writing batches with different schemas
• ARROW-295 - Create DOAP File
• ARROW-3086 - [Glib] GISCAN fails due to conda-shipped openblas
• ARROW-3096 - [Python] Update Python source build instructions given Anaconda/conda-forge toolchain migration
• ARROW-3133 - [C++] Logical boolean kernels in kernels/boolean.cc cannot write into preallocated memory
• ARROW-3208 - [C++] Segmentation fault when casting dictionary to numeric with nullptr valid_bitmap
• ARROW-3564 - [Python] writing version 2.0 parquet format with dictionary encoding enabled
• ARROW-3578 - [Release] Address spurious Apache RAT failures in source release script
• ARROW-3593 - [R] CI builds failing due to GitHub API rate limits
• ARROW-3606 - [Python] flake8 fails on Crossbow
• ARROW-3669 - [Python] Convert big-endian numbers or raise error in pyarrow.array
• ARROW-3843 - [Python] Writing Parquet file from empty table created with Table.from_pandas(..., preserve_index=False) fails
• ARROW-3923 - [Java] JDBC-to-Arrow Conversion: Unnecessary Calendar Requirement
• ARROW-4081 - [Go] Sum methods on Mac OS X panic when the array is empty
• ARROW-4104 - [Java] race in AllocationManager during release
• ARROW-4117 - [Python] "asv dev" command fails with latest revision
• ARROW-4181 - [Python] TestConvertStructTypes.test_from_numpy_large failing
• ARROW-4192 - "./dev/run_docker_compose.sh" is out of date
• ARROW-4213 - [Flight] C++ and Java implementations are incompatible
• ARROW-4244 - Clarify language around padding/alignment
• ARROW-4250 - [C++][Gandiva] Use approximate comparisons for floating point numbers in gandiva-projector-test
• ARROW-4252 - [C++] Status error context strings missing lines of code
• ARROW-4253 - [GLib] Cannot use non-system Boost specified with $BOOST_ROOT
• ARROW-4254 - [C++] Gandiva tests fail to compile with Boost in Ubuntu 14.04 apt
• ARROW-4255 - [C++] Schema::GetFieldIndex is not thread-safe
• ARROW-4261 - [C++] CMake paths for IPC, Flight, Thrift, and Plasma don't support using Arrow as a subproject
• ARROW-4264 - [C++] Document why DCHECKs are used in kernels
• ARROW-4267 - [Python/C++][Parquet] Segfault when reading rowgroups with duplicated columns
• ARROW-4274 - [Gandiva] static jni library broken after decimal changes
• ARROW-4275 - [C++] gandiva-decimal_single_test extremely slow
• ARROW-4280 - [C++][Documentation] It looks like flex and bison are required for parquet
• ARROW-4282 - [Rust] builder benchmark is broken
• ARROW-4284 - [C#] File / Stream serialization fails due to type mismatch / missing footer
• ARROW-4295 - [Plasma] Incorrect log message when evicting objects
• ARROW-4296 - [Plasma] Starting Plasma store with use_one_memory_mapped_file enabled crashes due to improper memory alignment
• ARROW-4312 - [C++] Lint doesn't work anymore ("[Errno 24] Too many open files")
• ARROW-4319 - plasma/store.h pulls ins flatbuffer dependency
• ARROW-4322 - [CI] docker nightlies fails after conda-forge compiler migration
• ARROW-4323 - [Packaging] Fix failing OSX clang conda forge builds
• ARROW-4326 - [C++] Development instructions in python/development.rst will not work for many Linux distros with new conda-forge toolchain
• ARROW-4327 - [Python] Add requirements-build.txt file to simplify setting up Python build environment
• ARROW-4328 - Make R build compatible with DARROW_TENSORFLOW=ON
• ARROW-4329 - Python should include the parquet headers
• ARROW-4342 - [Gandiva][Java] spurious failures in projector cache test
• ARROW-4347 - [Python] Run Python Travis CI unit tests on Linux when Java codebase changed
• ARROW-4349 - [C++] Build all benchmarks on Windows without failing
• ARROW-4351 - [C++] Fail to build with static parquet
• ARROW-4355 - [C++] test-util functions are no longer part of libarrow
• ARROW-4360 - [C++] Query homebrew for Thrift
• ARROW-4364 - [C++] Fix -weverything -wextra compilation errors
• ARROW-4366 - [Docs] Change extension from format/README.md to format/README.rst
• ARROW-4367 - [C++] StringDictionaryBuilder segfaults on Finish with only null entries
• ARROW-4368 - Bintray repository signature verification fails
• ARROW-4370 - [Python] Table to pandas conversion fails for list of bool
• ARROW-4374 - [C++] DictionaryBuilder does not correctly report length and null_count
• ARROW-4381 - [Docker] docker-compose build lint fails
• ARROW-4385 - [Python] default_version of a release should not include SNAPSHOT
• ARROW-4389 - [R] Installing clang-tools in CI is failing on trusty
• ARROW-4395 - ts-node throws type error running `bin/arrow2csv.js`
• ARROW-4400 - [CI] install of clang tools failing
• ARROW-4403 - [Rust] CI fails due to formatting errors
• ARROW-4404 - [CI] AppVeyor toolchain build does not build anything
• ARROW-4407 - [C++] ExternalProject_Add does not capture CC/CXX correctly
• ARROW-4410 - [C++] Fix InvertKernel edge cases
• ARROW-4413 - [Python] pyarrow.hdfs.connect() failing
• ARROW-4414 - [C++] Stop using cmake COMMAND_EXPAND_LISTS because it breaks package builds for older distros
• ARROW-4417 - [C++] Doc build broken
• ARROW-4420 - [INTEGRATION] Make spark integration test pass and test against spark's master branch
• ARROW-4421 - [Flight][C++] Handle large Flight data messages
• ARROW-4434 - [Python] Cannot create empty StructArray via pa.StructArray.from_arrays
• ARROW-4440 - [C++] Fix flatbuffers build using msvc
• ARROW-4457 - [Python] Cannot create Decimal128 array using integers
• ARROW-4469 - [Python][C++] CI Failing for Python 2.7 and 3.6 with valgrind
• ARROW-4471 - [C++] Pass AR and RANLIB to all external projects
• ARROW-4474 - [Flight] FlightInfo should use signed integer types for payload size
• ARROW-4496 - [CI] CI failing for python Xcode 7.3
• ARROW-4498 - [Plasma] Plasma fails building with CUDA enabled
• ARROW-4500 - [C++] librt and pthread hacks can cause linking problems
• ARROW-4501 - [C++] Unique returns non-unique strings
• ARROW-4525 - [Rust] [Parquet] Convert ArrowError to ParquetError
• ARROW-4527 - [Packaging] Update linux packaging tasks to align with the LLVM 7 migration
• ARROW-4532 - [Java] varchar value buffer much larger than expected
• ARROW-4533 - [Python] Document how to run hypothesis tests
• ARROW-4535 - [C++] Fix MakeBuilder to preserve ListType's field name
• ARROW-4536 - Add data_type argument in garrow_list_array_new
• ARROW-4538 - [PYTHON] Remove index column from subschema in write_to_dataframe
• ARROW-4549 - [C++] Can't build benchmark code on CUDA enabled build
• ARROW-4550 - [JS] Fix AMD pattern
• ARROW-4559 - [Python] pyarrow can't read/write filenames with special characters
• ARROW-4563 - [Python] pa.decimal128 should validate inputs
• ARROW-4571 - [Format] Tensor.fbs file has multiple root_type declarations
• ARROW-4576 - [Python] Benchmark failures
• ARROW-4577 - [C++] Interface link libraries declared on arrow_shared target that are actually non-interface
• ARROW-4581 - [C++] gbenchmark_ep is a dependency of unit tests when ARROW_BUILD_BENCHMARKS=ON
• ARROW-4582 - [C++/Python] Memory corruption on Pandas->Arrow conversion
• ARROW-4584 - [Python] Add built wheel to manylinux1 dockerignore.
• ARROW-4585 - [C++] Dependency of Flight C++ sources on generated protobuf is not respected
• ARROW-4587 - Flight C++ DoPut segfaults
• ARROW-4597 - [C++] Targets for system Google Mock shared library are missing
• ARROW-4601 - [Python] Master build is broken due to missing licence for .dockerignore
• ARROW-4608 - [C++] cmake script assumes that double-conversion installs static libs
• ARROW-4617 - [C++] Support double-conversion<3.1
• ARROW-4624 - [C++] Linker errors when building benchmarks
• ARROW-4629 - [Python] Pandas to arrow conversion slowed down by local imports
• ARROW-4639 - [CI] Crossbow build failing for Gandiva jars
• ARROW-4641 - [C++] Flight builds complain of -Wstrict-aliasing
• ARROW-4642 - [R] Change `f` to `file` in `read_parquet_file()`
• ARROW-4654 - [C++] Implicit Flight target dependencies cause compilation failure
• ARROW-4657 - [Release] gbenchmark should not be needed for verification
• ARROW-4658 - [C++] Shared gflags is also a run-time conda requirement
• ARROW-4659 - [CI] ubuntu/debian nightlies fail because of missing gandiva files
• ARROW-4660 - [C++] gflags fails to build due to CMake error
• ARROW-4664 - [C++] DCHECK macro conditions are evaluated in release builds
• ARROW-4669 - [Java] No Bounds checking on ArrowBuf.slice
• ARROW-4672 - [C++] clang-7 matrix entry is build using gcc
• ARROW-4680 - [CI] [Rust] Travis CI builds fail with latest Rust 1.34.0-nightly (2019-02-25)
• ARROW-4684 - [Python] CI failures in test_cython.py
• ARROW-4687 - [Python] FlightServerBase.run should exit on Ctrl-C
• ARROW-4688 - [C++][Parquet] 16MB limit on (nested) column chunk prevents tuning row_group_size
• ARROW-4696 - Verify release script is over optimist with CUDA detection
• ARROW-4699 - [C++] json parser should not rely on null terminated buffers
• ARROW-4710 - [C++][R] New linting script skip files with "cpp" extension
• ARROW-4712 - [C++][CI] Clang7 Valgrind complains when not move shared_ptr
• ARROW-4721 - [Rust] [DataFusion] Propagate schema in filter
• ARROW-4728 - [JS] Failing test Table#assign with a zero-length Null column round-trips through serialization
• ARROW-4737 - [C#] tests are not running in CI
• ARROW-4744 - [CI][C++] Mingw32 builds failing
• ARROW-4750 - [C++] RapidJSON triggers Wclass-memaccess on GCC 8+
• ARROW-4760 - [C++] protobuf 3.7 defines EXPECT_OK that clashes with Arrow's macro
• ARROW-4766 - [C++] Casting empty boolean array causes segfault
• ARROW-4767 - [C#] ArrowStreamReader crashes while reading the end of a stream
• ARROW-4774 - [C++][Parquet] Call Table::Validate when writing a table
• ARROW-4775 - [Website] Site navbar cannot be expanded
• ARROW-4783 - [C++][CI] Mingw32 builds sometimes timeout
• ARROW-4796 - [Flight][Python] segfault in simple server implementation
• ARROW-4802 - [Python] Hadoop classpath discovery broken HADOOP_HOME is a symlink
• ARROW-4807 - [Rust] Fix csv_writer benchmark
• ARROW-4811 - [C++] An incorrect dependency leads "ninja" to re-evaluate steps unnecessarily on subsequent calls
• ARROW-4820 - [Python] hadoop class path derived not correct
• ARROW-4822 - [C++/Python] pyarrow.Table.equals segmentation fault on None
• ARROW-4828 - [Python] manylinux1 docker-compose context should be python/manylinux1
• ARROW-4850 - [CI] Integration test failures do not fail the Travis CI build
• ARROW-4853 - [Rust] Array slice doesn't work on ListArray and StructArray
• ARROW-4857 - [C++/Python/CI] docker-compose in manylinux1 crossbow jobs too old
• ARROW-4866 - [C++] zstd ExternalProject failing on Windows
• ARROW-4867 - [Python] Table.from_pandas() column order not respected
• ARROW-4869 - [C++] Use of gmock fails in compute/kernels/util-internal-test.cc
• ARROW-4870 - [Ruby] gemspec has wrong msys2 dependency listed
• ARROW-4871 - [Flight][Java] Handle large Flight messages
• ARROW-4872 - [Python] Keep backward compatibility for ParquetDatasetPiece
• ARROW-4881 - [Python] bundle_zlib CMake function still uses ARROW_BUILD_TOOLCHAIN
• ARROW-4900 - mingw-w64 < 5 does not have __cpuidex
• ARROW-4903 - [C++] Building tests using only static libs not possible
• ARROW-4906 - [Format] Fix document to describe that SparseMatrixIndexCSR assumes indptr is sorted for each row
• ARROW-4918 - [C++] Add cmake-format to pre-commit
• ARROW-4928 - [Python] Hypothesis test failures
• ARROW-4931 - [C++] CMake fails on gRPC ExternalProject
• ARROW-4948 - [JS] Nightly test failing with "Cannot assign to read only property"
• ARROW-4950 - [C++] Thirdparty CMake error get_target_property() called with non-existent target LZ4::lz4
• ARROW-4952 - [C++] Equals / ApproxEquals behaviour undefined on FP NaNs
• ARROW-4954 - [Python] test failure with Flight enabled
• ARROW-4958 - [C++] Purely static linking broken
• ARROW-4961 - [C++][Python] Add GTest_SOURCE=BUNDLED to relevant build docs that use conda-forge toolchain
• ARROW-4962 - [C++] Warning level to CHECKIN can't compile on modern GCC
• ARROW-4976 - [JS] RecordBatchReader should reset its Node/DOM streams
• ARROW-4984 - [Flight][C++] Flight server segfaults when port is in use
• ARROW-4986 - [CI] Travis fails to install llvm@7
• ARROW-4989 - [C++] Builds fails to find Ubuntu-packaged re2 library
• ARROW-4991 - [CI] Bump travis node version to 11.12
• ARROW-4997 - [C#] ArrowStreamReader doesn't consume whole stream and doesn't implement sync read
• ARROW-5009 - [C++] Cleanup using to std::* in files
• ARROW-5010 - [Release] Fix release script with llvm-7
• ARROW-5012 - [C++] "testing" headers not installed
• ARROW-5023 - [Release] Default value syntax in shell is wrong
• ARROW-5024 - [Release] crossbow.py --arrow-version causes missing variable error
• ARROW-5025 - [Python][Packaging] wheel for Windows are broken
• ARROW-5026 - [Python][Packaging] conda package on non Windows is broken
• ARROW-5029 - [C++] Compilation warnings in release mode
• ARROW-5031 - [Dev] Release verification script does not run CUDA tests in Python
• ARROW-5042 - [Release] Wrong ARROW_DEPENDENCY_SOURCE in verification script
• ARROW-5043 - [Release][Ruby] red-arrow dependency can't be resolve in verification script
• ARROW-5044 - [Release][Rust] Format error in verification script
• ARROW-5046 - [Release][C++] Plasma test is fragile in verification script
• ARROW-5047 - [Release] Always set up parquet-testing in verification script
• ARROW-5048 - [Release][Rust] arrow-testing is missing in verification script

Improvement

• ARROW-1425 - [Python] Document semantic differences between Spark timestamps and Arrow timestamps
• ARROW-1639 - [Python] More efficient serialization for RangeIndex in serialize_pandas
• ARROW-1807 - [JAVA] Reduce Heap Usage (Phase 3): consolidate buffers
• ARROW-1896 - [C++] Do not allocate memory for primitive outputs in CastKernel::Call implementation
• ARROW-2015 - [Java] Use Java Time and Date APIs instead of JodaTime
• ARROW-2022 - [Format] Add custom metadata field specific to a RecordBatch message
• ARROW-2112 - [C++] Enable cpplint to be run on Windows
• ARROW-2627 - [Python] Add option (or some equivalent) to toggle memory mapping functionality when using parquet.ParquetFile or other read entry points
• ARROW-3149 - [C++] Use gRPC (when it exists) from conda-forge for CI builds
• ARROW-3239 - [C++] Improve random data generation functions
• ARROW-3292 - [C++] Test Flight RPC in Travis CI
• ARROW-3297 - [Python] Python bindings for Flight C++ client
• ARROW-331 - [Python] Timeline for dropping Python 2.7 support
• ARROW-3361 - [R] Run cpp/build-support/cpplint.py on C++ source files
• ARROW-3364 - [Doc] Document docker compose setup
• ARROW-3367 - [INTEGRATION] Port Spark integration test to the docker-compose setup
• ARROW-3422 - [C++] Add "toolchain" target to ensure that all required toolchain libraries are built
• ARROW-3532 - [Python] Schema, StructType, StructArray field retrieval by name should raise warning or exception for multiple matches
• ARROW-3550 - [C++] Use kUnknownNullCount in NumericArray constructor
• ARROW-3554 - [C++] Reverse traits for C++
• ARROW-3619 - [R] Expose global thread pool optins
• ARROW-3653 - [Python/C++] Support data copying between different GPU devices
• ARROW-3735 - [Python] Proper error handling in _ensure_type
• ARROW-3769 - [C++] Support reading non-dictionary encoded binary Parquet columns directly as DictionaryArray
• ARROW-3770 - [C++] Validate or add option to validate arrow::Table schema in parquet::arrow::FileWriter::WriteTable
• ARROW-3824 - [R] Document developer workflow for building project, running unit tests in r/README.md
• ARROW-3838 - [Rust] Implement CSV Writer
• ARROW-3846 - [Gandiva] Build on Windows
• ARROW-3882 - [Rust] PrimitiveArray should support cast operations
• ARROW-3903 - [Python] Random array generator for Arrow conversion and Parquet testing
• ARROW-3926 - [Python] Add Gandiva bindings to Python wheels
• ARROW-3951 - [Go] implement a CSV writer
• ARROW-3954 - [Rust] Add Slice to Array and ArrayData
• ARROW-3965 - [Java] JDBC-to-Arrow Conversion: Configuration Object
• ARROW-3966 - [Java] JDBC-to-Arrow Conversion: JDBC Metadata in Schema Fields
• ARROW-3972 - [C++] Update to LLVM and Clang bits to 7.0
• ARROW-3985 - [C++] Pass -C option when compiling with ccache to avoid some warnings
• ARROW-4012 - [Documentation][C++] Document how to install Apache Arrow on MSYS2
• ARROW-4014 - [C++] Fix "LIBCMT" warnings on MSVC
• ARROW-4024 - [Python] Cython compilation error on cython==0.27.3
• ARROW-4031 - [C++] Refactor ArrayBuilder bitmap logic into TypedBufferBuilder
• ARROW-4056 - [C++] Upgrade to boost-cpp 1.69.0 again
• ARROW-4094 - [Python] Store RangeIndex in Parquet files as metadata rather than a physical data column
• ARROW-4110 - [C++] Do not generate distinct cast kernels when input and output type are the same
• ARROW-4123 - [C++] Improve linting workflow and documentation for Windows-based developers
• ARROW-4124 - [C++] Abstract aggregation kernel API
• ARROW-4142 - [Java] JDBC-to-Arrow: JDBC Arrays
• ARROW-4165 - [C++] Port cpp/apidoc/Windows.md and other files to Sphinx / rst
• ARROW-4180 - [Java] Reduce verbose logging of ArrowBuf creation events?
• ARROW-4196 - [Rust] Add explicit SIMD vectorization for arithmetic ops in "array_ops"
• ARROW-4198 - [Gandiva] Add support to cast timestamp
• ARROW-4212 - [Python] [CUDA] Creating a CUDA buffer from Numba device array should be easier
• ARROW-4230 - [C++] Enable building flight against system gRPC
• ARROW-4234 - [C++] Add memory bandwidth benchmarks to arrow/util/machine-benchmark.cc
• ARROW-4235 - [GLib] Use "column_builder" in GArrowRecordBatchBuilder
• ARROW-4236 - [JAVA] Distinct plasma client create exceptions
• ARROW-4245 - [Rust] Add Rustdoc header to each source file
• ARROW-4247 - [Packaging] Update verify script for 0.12.0
• ARROW-4251 - [C++] Add option to use vendored Boost in verify-release-candidate.sh
• ARROW-4263 - [Rust] Donate DataFusion
• ARROW-4268 - [C++] Add C primitive to Arrow:Type compile time in TypeTraits
• ARROW-4277 - [C++] Add gmock to toolchain
• ARROW-4285 - [Python] Use proper builder interface for serialization
• ARROW-4297 - [C++] Fix build for 32-bit MSYS2
• ARROW-4299 - [Ruby] Depend on the same version as Red Arrow
• ARROW-4305 - [Rust] Fix parquet version number in README
• ARROW-4307 - [C++] FIx doxygen warnings, include doxygen warning checks in CI linting
• ARROW-4310 - [Website] Update install document for 0.12.0
• ARROW-4315 - [Website] Home page of https://arrow.apache.org/ does not mention Go or Rust
• ARROW-4330 - [C++] Use FindThreads.cmake to handle -pthread compiler/link options
• ARROW-4332 - [Website] Instructions and scripts for publishing web site appear to be incorrect
• ARROW-4335 - [C++] Better document sparse tensor support
• ARROW-4336 - [C++] Default BUILD_WARNING_LEVEL to CHECKIN
• ARROW-4339 - [C++] rewrite cpp/README shorter, with a separate contribution guide
• ARROW-4340 - [C++] Update IWYU version in the `lint` dockerfile
• ARROW-4341 - [C++] Use TypedBufferBuilder in BooleanBuilder
• ARROW-4344 - [Java] Further cleanup maven output
• ARROW-4345 - [C++] Add Apache 2.0 license file to the Parquet-testing repository
• ARROW-4346 - [C++] Fix compiler warnings with gcc 8.2.0
• ARROW-4353 - [CI] Add jobs for 32-bit and 64-bit MinGW
• ARROW-4361 - [Website] Update commiters list
• ARROW-4362 - [Java] Test OpenJDK 11 in CI
• ARROW-4363 - [C++] Add CMake format checks
• ARROW-4372 - [C++] Embed precompiled bitcode in the gandiva library
• ARROW-4373 - [Packaging] Travis fails to deploy conda packages on OSX
• ARROW-4375 - [CI] Sphinx dependencies were removed from docs conda environment
• ARROW-4376 - [Rust] Implement from_buf_reader for csv::Reader
• ARROW-4377 - [Rust] Implement std::fmt::Debug for all PrimitiveArrays
• ARROW-4379 - Register pyarrow serializers for collections.Counter and collections.deque.
• ARROW-4383 - [C++] Use the CMake's standard find features
• ARROW-4388 - [Go] add DimNames() method to tensor Interface?
• ARROW-4393 - [Rust] coding style: apply 90 characters per line limit
• ARROW-4396 - Update Typedoc to support TypeScript 3.2
• ARROW-4399 - [C++] Remove usage of "extern template class" from NumericArray
• ARROW-4401 - [Python] Alpine dockerfile fails to build because pandas requires numpy as build dependency
• ARROW-4406 - Ignore "*_$folder$" files on S3
• ARROW-4422 - [Plasma] Enforce memory limit in plasma, rather than relying on dlmalloc_set_footprint_limit
• ARROW-4423 - [C++] Update version of vendored gtest to 1.8.1
• ARROW-4424 - [Python] Manylinux CI builds failing
• ARROW-4430 - [C++] add unit test for currently unused append method
• ARROW-4431 - [C++] Build gRPC as ExternalProject without allowing it to build its vendored dependencies
• ARROW-4436 - [Documentation] Clarify instructions for building documentation
• ARROW-4442 - [JS] Overly broad type annotation for Chunked typeId leading to type mismatches in generated typing
• ARROW-4444 - [Testing] Add DataFusion test files to arrow-testing repo
• ARROW-4445 - [C++][Gandiva] Run Gandiva-LLVM tests in Appveyor
• ARROW-4446 - [Python] Run Gandiva tests on Windows and Appveyor
• ARROW-4448 - [JAVA][Flight] Flaky Flight java test
• ARROW-4454 - [C++] fix unused parameter warnings
• ARROW-4455 - [Plasma] g++ 8 reports class-memaccess warnings
• ARROW-4459 - [Testing] Add git submodule for arrow-testing data files
• ARROW-4460 - [Website] Write blog post to announce DataFusion donation
• ARROW-4462 - [C++] Upgrade LZ4 v1.7.5 to v1.8.3 to compile with VS2017
• ARROW-4464 - [Rust] [DataFusion] Add support for LIMIT
• ARROW-4466 - [Rust] [DataFusion] Add support for Parquet data sources
• ARROW-4468 - [Rust] Implement BitAnd/BitOr for &Buffer (with SIMD)
• ARROW-4475 - [Python] Serializing objects that contain themselves
• ARROW-4476 - [Rust] [DataFusion] Post donation clean up tasks
• ARROW-4481 - [Website] Instructions for publishing web site are missing a step
• ARROW-4483 - [Website] Fix broken link (author) in DataFusion blog post
• ARROW-4485 - [CI] Determine maintenance approach to pinned conda-forge binutils package
• ARROW-4486 - [Python][CUDA] pyarrow.cuda.Context.foreign_buffer should have a `base=None` argument
• ARROW-4488 - [Rust] From AsRef<[u8]> for Buffer does not ensure correct padding
• ARROW-4489 - [Rust] PrimitiveArray.value_slice performs bounds checking when it should not
• ARROW-4490 - [Rust] Add explicit SIMD vectorization for boolean ops in "array_ops"
• ARROW-4491 - [Python] Remove usage of std::to_string and std::stoi
• ARROW-4499 - [Python][CI] Upgrade to latest flake8 3.7.5 in travis_lint.sh
• ARROW-4502 - [C#] Add support for zero-copy reads
• ARROW-4513 - [Rust] Implement BitAnd/BitOr for &Bitmap
• ARROW-4528 - [C++] Update lint docker container to LLVM-7
• ARROW-4529 - [C++] Add test coverage for BitUtils::RoundDown
• ARROW-4531 - [C++] Handling of non-aligned slices in Sum kernel
• ARROW-4537 - [CI] Suppress shell warning on travis-ci
• ARROW-4547 - [Python][Documentation] Update python/development.rst with instructions for CUDA-enabled builds
• ARROW-4558 - [C++][Flight] Avoid undefined behavior with gRPC memory optimizations
• ARROW-4560 - [R] array() needs to take single input, not ...
• ARROW-4562 - [C++][Flight] Create outgoing composite grpc::ByteBuffer instead of allocating contiguous slice and copying IpcPayload into it
• ARROW-4565 - [R] Reading records with all non-null decimals SEGFAULTs
• ARROW-4568 - [C++] Add version macros to headers
• ARROW-4572 - [C++] Remove memory zeroing from PrimitiveAllocatingUnaryKernel
• ARROW-4583 - [Plasma] There are bugs reported by code scan tool
• ARROW-4586 - [Rust] Remove arrow/mod.rs as it is not needed
• ARROW-4590 - [Rust] Add explicit SIMD vectorization for comparison ops in "array_ops"
• ARROW-4592 - [GLib] Stop configure immediately when GLib isn't available
• ARROW-4593 - [Ruby] Arrow::Array#[out_of_range] returns nil
• ARROW-4594 - [Ruby] Arrow::StructArray#[] returns Arrow::Struct instead of Arrow::Array
• ARROW-4595 - [Rust] [DataFusion] Implement DataFrame style API
• ARROW-4598 - [CI] Remove needless LLVM_DIR for macOS
• ARROW-4602 - [Rust][ [DataFusion] Integrate query optimizer with ExecutionContext
• ARROW-4605 - [Rust] Move filter and limit code from DataFusion into compute module
• ARROW-4609 - [C++] Use google benchmark from toolchain
• ARROW-4610 - [Plasma] Avoid JNI from crashing
• ARROW-4611 - [C++] Rework CMake third-party logic
• ARROW-4612 - [Python] Use cython from PyPI for windows wheels build
• ARROW-4613 - [C++] Alpine build failing as libgtestd.so is not found
• ARROW-4614 - [C++/CI] Activate flight build in ci/docker_build_cpp.sh
• ARROW-4615 - [C++] Add checked_pointer_cast
• ARROW-4616 - [C++] Log message in BuildUtils as STATUS
• ARROW-4618 - [Docker] Makefile to build dependent docker images
• ARROW-4623 - [R] update Rcpp dependency
• ARROW-4628 - [Rust] [DataFusion] Implement type coercion query optimizer rule
• ARROW-4634 - [Rust] [Parquet] Reorganize test_common mod to allow more test util codes.
• ARROW-4637 - [Python] Avoid importing Pandas unless necessary
• ARROW-4638 - [R] install instructions using brew
• ARROW-4640 - [Python] Add docker-compose configuration to build and test the project without pandas installed
• ARROW-4643 - [C++] Add compiler diagnostic color when using Ninja
• ARROW-4644 - [C++/Docker] Build Gandiva in the docker containers
• ARROW-4645 - [C++/Packaging] Ship Gandiva with OSX and Windows wheels
• ARROW-4646 - [C++/Packaging] Ship gandiva with the conda-forge packages
• ARROW-4655 - [Packaging] Parallelize binary upload
• ARROW-4667 - [C++] Suppress unused function warnings with MinGW
• ARROW-4670 - [Rust] compute::sum performance issue
• ARROW-4673 - [C++] Implement AssertDatumEquals
• ARROW-4676 - [C++] Add support for debug build with MinGW
• ARROW-4678 - [Rust] Minimize unstable feature usage
• ARROW-4679 - [Rust] [DataFusion] Implement in-memory DataSource
• ARROW-4681 - [Rust] [DataFusion] Implement parallel query execution using threads
• ARROW-4686 - Only accept 'y' or 'n' in merge_arrow_pr.py prompts
• ARROW-4689 - [Go] add support for WASM
• ARROW-4690 - [Python] Building TensorFlow compatible wheels for Arrow
• ARROW-4697 - [C++] Add URI parsing facility
• ARROW-4705 - [Rust] CSV reader should show line number and error message when failing to parse a line
• ARROW-4718 - Add ArrowStreamWriter/Reader ctors that leave open the underlying Stream
• ARROW-4727 - [Rust] Implement ability to check if two schemas are the same
• ARROW-4730 - [C++] Add docker-compose entry for testing Fedora build with system packages
• ARROW-4731 - [C++] Add docker-compose entry for testing Ubuntu Xenial build with system packages
• ARROW-4732 - [C++] Add docker-compose entry for testing Debian Testing build with system packages
• ARROW-4733 - [C++] Add CI entry that builds without the conda-forge toolchain but with system packages
• ARROW-4734 - [Go] Add option to write a header for CSV writer
• ARROW-4735 - [Go] Benchmark strconv.Format vs. fmt.Sprintf for CSV writer
• ARROW-4739 - [Rust] [DataFusion] It should be possible to share a logical plan between threads
• ARROW-4745 - [C++][Documentation] Document process for replicating static_crt builds on windows
• ARROW-4749 - [Rust] RecordBatch::new() should return result instead of panicking
• ARROW-4754 - [CI][Java] Flaky TestAuth Flight test
• ARROW-4769 - [Rust] Improve array limit function where max records > len
• ARROW-4776 - [C++] DictionaryBuilder should support bootstrapping from an existing dict type
• ARROW-4777 - [C++/Python] manylinux1: Update lz4 to 1.8.3
• ARROW-4789 - [C++] Deprecate and later remove arrow::io::ReadableFileInterface
• ARROW-4791 - Unused dependencies in arrow and datafusion
• ARROW-4794 - [Python] Make pandas an optional test dependency
• ARROW-4797 - [Plasma] Avoid store crash if not enough memory is available
• ARROW-4801 - [GLib] Suppress pkgconfig.generate() warnings
• ARROW-4817 - [Rust] [DataFusion] Small re-org of modules
• ARROW-4826 - [Go] export Flush method for CSV writer
• ARROW-4831 - [C++] CMAKE_AR is not passed to ZSTD thirdparty dependency
• ARROW-4833 - [Release] Document how to update the brew formula in the release management guide
• ARROW-4834 - [R] Feature flag to disable parquet
• ARROW-4837 - [C++] Support c++filt on a custom path in the run-test.sh script
• ARROW-4839 - [C#] Add NuGet support
• ARROW-4846 - [Java] Update Jackson to 2.9.8
• ARROW-4849 - [C++] Add docker-compose entry for testing Ubuntu Bionic build with system packages
• ARROW-4854 - [Rust] Use Array Slice for limit kernel
• ARROW-4855 - [Packaging] Generate default package version based on cpp tags in crossbow.py
• ARROW-4858 - [Flight][Python] Enable custom FlightDataStream in Python
• ARROW-4865 - [Rust] Support casting lists and primitives to lists
• ARROW-4873 - [C++] Clarify documentation about how to use external ARROW_PACKAGE_PREFIX while also using CONDA dependency resolution
• ARROW-4878 - [C++] ARROW_DEPENDENCY_SOURCE=CONDA does not work properly with MSVC
• ARROW-4889 - [C++] Add STATUS messages for Protobuf in CMake
• ARROW-4891 - [C++] ZLIB include directories not added
• ARROW-4893 - [C++] conda packages should use $PREFIX inside of conda-build
• ARROW-4894 - [Rust] [DataFusion] Remove all uses of panic! from aggregate.rs
• ARROW-4896 - [Rust] [DataFusion] Remove all uses of panic! from tests
• ARROW-4897 - [Rust] [DataFusion] Improve Rustdoc
• ARROW-4898 - [C++] Old versions of FindProtobuf.cmake use ALL-CAPS for variables
• ARROW-4899 - [Rust] [DataFusion] Remove all uses of panic! from expression.rs
• ARROW-4905 - [C++][Plasma] Remove dlmalloc from client library
• ARROW-4908 - [Rust] [DataFusion] Add support for parquet date/time in int32/64 encoding
• ARROW-4910 - [Rust] [DataFusion] Remove all uses of unimplemented!
• ARROW-4922 - [Packaging] Use system libraris for .deb and .rpm
• ARROW-4926 - [Rust] [DataFusion] Update README for 0.13.0 release
• ARROW-4933 - [R] Autodetect Parquet support using pkg-config
• ARROW-4937 - [R] Clean pkg-config related logic
• ARROW-4939 - [Python] Add wrapper for "sum" kernel
• ARROW-4940 - [Rust] Enhance documentation for datafusion
• ARROW-4944 - [C++] Raise minimal required thrift-cpp to 0.11 in conda environment
• ARROW-4946 - [C++] Support detection of flatbuffers without FlatbuffersConfig.cmake
• ARROW-4947 - [Flight][C++/Python] Remove redundant schema parameter in DoGet
• ARROW-4964 - [Ruby] Add closed check if available on auto close
• ARROW-4969 - [C++] Set RPATH in correct order for test executables on OSX
• ARROW-4977 - [Ruby] Add support for building on Windows
• ARROW-4978 - [Ruby] Fix wrong internal variable name for table data
• ARROW-4979 - [GLib] Add missing lock to garrow::GIOInputStream
• ARROW-4980 - [GLib] Use GInputStream as the parent of GArrowInputStream
• ARROW-4983 - [Plasma] Unmap memory when the client is destroyed
• ARROW-4995 - [R] Make sure winbuilder tests pass for package
• ARROW-4996 - [Plasma] There are many log files in /tmp
• ARROW-5003 - [R] remove dependency on withr
• ARROW-5006 - [R] parquet.cpp does not include enough Rcpp
• ARROW-5011 - [Release] Add support in the source release script for custom hash
• ARROW-5013 - [Rust] [DataFusion] Refactor runtime expression support
• ARROW-5014 - [Java] Fix typos in Flight module
• ARROW-5018 - [Release] Include JavaScript implementation
• ARROW-5032 - [C++] Headers in vendored/datetime directory aren't installed
• ARROW-572 - [C++] Apply visitor pattern in IPC metadata

New Feature

• ARROW-1572 - [C++] Implement "value counts" kernels for tabulating value frequencies
• ARROW-3107 - [C++] arrow::PrettyPrint for Column instances
• ARROW-3121 - [C++] Mean kernel aggregate
• ARROW-3123 - [C++] Incremental Count, Count Not Null aggregator
• ARROW-3135 - [C++] Add helper functions for validity bitmap propagation in kernel context
• ARROW-3162 - [Python] Enable Flight servers to be implemented in pure Python
• ARROW-3289 - [C++] Implement DoPut command for Flight on client and server side
• ARROW-3311 - [R] Functions for deserializing IPC components from arrow::Buffer or from IO interface
• ARROW-3631 - [C#] Add Appveyor build for C#
• ARROW-3761 - [R] Bindings for CompressedInputStream, CompressedOutputStream
• ARROW-3816 - [R] nrow.RecordBatch method
• ARROW-4262 - [Website] Blog post to give preview into using R and Arrow with Apache Spark
• ARROW-4265 - [C++] Automatic conversion between Table and std::vector<std::tuple<..>>
• ARROW-4287 - [C++] Ensure minimal bison version on OSX for Thrift
• ARROW-4289 - [C++] Forward AR and RANLIB to thirdparty builds
• ARROW-4290 - [C++/Gandiva] Support detecting correct LLVM version in Homebrew
• ARROW-4291 - [Dev] Support selecting features in release scripts
• ARROW-4294 - [Plasma] Add support for evicting objects to external store
• ARROW-4298 - [Java] Building Flight fails with OpenJDK 11
• ARROW-4300 - [C++] Restore apache-arrow Homebrew recipe and define process for maintaining and updating for releases
• ARROW-4313 - Define general benchmark database schema
• ARROW-4318 - [C++] Add Tensor::CountNonZero
• ARROW-4352 - [C++] Add support for system Google Test
• ARROW-4386 - [Rust] Implement Date and Time Arrays
• ARROW-4397 - [C++] dim_names in Tensor and SparseTensor
• ARROW-4449 - [Rust] Convert File to T: Read + Seek for schema inference
• ARROW-4472 - [Website][Python] Blog post about Python string memory use improvements in 0.12
• ARROW-4506 - [Ruby] Add Arrow::RecordBatch#raw_records
• ARROW-4632 - [Ruby] Add BigDecimal#to_arrow
• ARROW-4662 - [Python] Add type_codes property in UnionType
• ARROW-4671 - [C++] MakeBuilder doesn't support Type::DICTIONARY
• ARROW-4692 - [Format][Documentation] Add more details about "sidecar" to flight proto
• ARROW-47 - [C++] Consider adding a scalar type object model
• ARROW-4707 - [C++] move BitsetStack to bit-util.h
• ARROW-4740 - [Java] Upgrade to JUnit 5
• ARROW-4782 - [C++] Prototype scalar and array expression types for developing deferred operator algebra
• ARROW-4835 - [GLib] Add boolean operations
• ARROW-4859 - [GLib] Add garrow_numeric_array_mean()
• ARROW-4862 - [GLib] Add GArrowCastOptions::allow-invalid-utf8 property
• ARROW-4882 - [GLib] Add "Sum" functions
• ARROW-4887 - [GLib] Add garrow_array_count()
• ARROW-4901 - [Go] Run tests in Appveyor
• ARROW-4915 - [GLib] Add support for arrow::NullBuilder
• ARROW-4924 - [Ruby] Add Decimal128#to_s(scale=nil)
• ARROW-4929 - [GLib] Add garrow_array_count_values()
• ARROW-4955 - [GLib] Add garrow_file_is_closed()
• ARROW-4981 - [Ruby] Add support for CSV data encoding conversion
• ARROW-5041 - [Release][C++] use bundled gtest and gmock in verify-release-candidate.bat
• ARROW-549 - [C++] Add function to concatenate like-typed arrays
• ARROW-585 - [C++] Define public API for user-defined data types
• ARROW-694 - [C++] Build JSON "scanner" for reading record batches from line-delimited JSON files

Sub-task

• ARROW-3596 - [Packaging] Build gRPC in conda-forge
• ARROW-4061 - [Rust] [Parquet] Implement "spaced" version for non-dictionary encoding/decoding
• ARROW-4461 - [C++] Expose bit-util methods for binary boolean operations that don't allocate
• ARROW-4540 - [Rust] Add basic JSON reader
• ARROW-4543 - [C#] Update Flat Buffers code to latest version
• ARROW-4556 - [Rust] Preserve order of JSON inferred schema
• ARROW-4599 - [C++] Add support for system GFlags
• ARROW-4743 - [Java] Fix documentation in arrow memory module
• ARROW-4772 - Provide new ORC adapter interface that allow user to specify row number
• ARROW-4892 - [Rust] [DataFusion] Move SQL parser and planner into sql package
• ARROW-4895 - [Rust] [DataFusion] Move error.rs to top level package

Task

• ARROW-2409 - [Rust] Test for build warnings, remove current warnings
• ARROW-3511 - [Gandiva] support input selection vectors for both projector and filter
• ARROW-4071 - [Rust] Add rustfmt as a pre-commit hook
• ARROW-4072 - [Rust] Set default value for PARQUET_TEST_DATA
• ARROW-4204 - [Gandiva] implement decimal subtract
• ARROW-4205 - [Gandiva] Implement decimal multiply
• ARROW-4206 - [Gandiva] Implement decimal divide
• ARROW-4271 - [Rust] Move Parquet specific info to Parquet Readme
• ARROW-4273 - [Release] Fix verification script to use cf201901 conda-forge label
• ARROW-4281 - [CI] Use Ubuntu Xenial (16.04) VMs on Travis-CI
• ARROW-4303 - [Gandiva/Python] Build LLVM with RTTI in manylinux1 container
• ARROW-4321 - [CI] Setup conda-forge channel globally in docker containers
• ARROW-4334 - [CI] Setup conda-forge channel globally in travis builds
• ARROW-4358 - [Gandiva][Crossbow] Trusty build broken
• ARROW-4408 - [CPP/Doc] Remove outdated Parquet documentation
• ARROW-4425 - Add link to 'Contributing' page in the top-level Arrow README
• ARROW-4435 - [C#] Add .sln file and minor .csproj fix ups
• ARROW-4518 - [JS] add jsdelivr to package.json
• ARROW-4539 - [Java]List vector child value count not set correctly
• ARROW-4619 - [R]: Fix the autobrew script
• ARROW-4620 - [C#] Add unit tests for "Types" in arrow/csharp
• ARROW-4693 - [CI] Build boost library with multi precision
• ARROW-4751 - [C++] Add pkg-config to conda_env_cpp.yml
• ARROW-4756 - [CI] document the procedure to update docker image for manylinux1 builds
• ARROW-4758 - [Flight] Build fails on Mac due to missing Schema_generated.h
• ARROW-4778 - [C++/Python] manylinux1: Update Thrift to 0.12.0
• ARROW-4786 - [C++/Python] Support better parallelisation in manylinux1 base build
• ARROW-4790 - [Python/Packaging] Update manylinux docker image in crossbow task
• ARROW-4808 - [Java][Vector] Convenience methods for setting decimal vector
• ARROW-4907 - [CI] Add docker container to inspect docker context
• ARROW-4909 - [CI] Use hadolint to lint Dockerfiles
• ARROW-4932 - [GLib] Use G_DECLARE_DERIVABLE_TYPE macro
• ARROW-4951 - [C++] Turn off cpp benchmarks in cpp docker images
• ARROW-4994 - [website] Update Details for ptgoetz

Test

• ARROW-4320 - [C++] Add tests for non-contiguous tensors
• ARROW-4704 - [CI][GLib] Plasma test is flaky
• ARROW-4724 - [C++] Python not being built nor test under MinGW builds
• ARROW-4768 - [C++][CI] arrow-test-array sometimes gets stuck in MinGW build
• ARROW-4793 - [Ruby] Suppress unused variable warning
• ARROW-4813 - [Ruby] Add tests for #== and #!=
• ARROW-4942 - [Ruby] Remove needless omits
• ARROW-4982 - [GLib][CI] Run tests on AppVeyor

Wish

• ARROW-3981 - [C++] Rename json.h

Apache Arrow 0.12.0 (16 January 2019)

Bug

• ARROW-1847 - [Doc] Document the difference between RecordBatch and Table in an FAQ fashion
• ARROW-1994 - [Python] Test against Pandas master
• ARROW-2026 - [Python] Cast all timestamp resolutions to INT96 use_deprecated_int96_timestamps=True
• ARROW-2038 - [Python] Follow-up bug fixes for s3fs Parquet support
• ARROW-2113 - [Python] Incomplete CLASSPATH with "hadoop" contained in it can fool the classpath setting HDFS logic
• ARROW-2591 - [Python] Segmentation fault when writing empty ListType column to Parquet
• ARROW-2592 - [Python] Error reading old Parquet file due to metadata backwards compatibility issue
• ARROW-2708 - [C++] Internal GetValues function in arrow::compute should check for nullptr
• ARROW-2970 - [Python] NumPyConverter::Visit for Binary/String/FixedSizeBinary can overflow
• ARROW-3058 - [Python] Feather reads fail with unintuitive error when conversion from pandas yields ChunkedArray
• ARROW-3186 - [GLib] mesonbuild failures in Travis CI
• ARROW-3202 - [C++] Build does not succeed on Alpine Linux
• ARROW-3225 - [C++/Python] Pandas object conversion of ListType and ListType
• ARROW-3324 - [Parquet] Free more internal resources when writing multiple row groups
• ARROW-3343 - [Java] Java tests fail non-deterministically with memory leak from Flight tests
• ARROW-3405 - [Python] Document CSV reader
• ARROW-3428 - [Python] from_pandas gives incorrect results when converting floating point to bool
• ARROW-3436 - [C++] Boost version required by Gandiva is too new for Ubuntu 14.04
• ARROW-3437 - [Gandiva][C++] Configure static linking of libgcc, libstdc++ with LDFLAGS
• ARROW-3438 - [Packaging] Escaped bulletpoints in changelog
• ARROW-3445 - [GLib] Parquet GLib doesn't link Arrow GLib
• ARROW-3449 - [C++] Support CMake 3.2 for "out of the box" builds
• ARROW-3466 - [Python] Crash when importing tensorflow and pyarrow
• ARROW-3467 - Building against external double conversion is broken
• ARROW-3470 - [C++] Row-wise conversion tutorial has fallen out of date
• ARROW-3477 - [C++] Testsuite fails on 32 bit arch
• ARROW-3480 - [Website] Install document for Ubuntu is broken
• ARROW-3485 - [C++] Examples fail with Protobuf error
• ARROW-3494 - [C++] re2 conda-forge package not working in toolchain
• ARROW-3516 - [C++] Use unsigned type for difference of pointers in parallel_memcpy
• ARROW-3517 - [C++] MinGW 32bit build causes g++ segv
• ARROW-3524 - [C++] Fix compiler warnings from ARROW-3409 on clang-6
• ARROW-3527 - [R] Unused variables in R-package C++ code
• ARROW-3528 - [R] Typo in R documentation
• ARROW-3535 - [Python] pip install tensorflow install too new numpy in manylinux1 build
• ARROW-3541 - [Rust] Update BufferBuilder to allow for new bit-packed BooleanArray
• ARROW-3544 - [Gandiva] Populate function registry in multiple compilation units to mitigate long compile times in release mode
• ARROW-3549 - [Rust] Replace i64 with usize for some bit utility functions
• ARROW-3573 - [Rust] with_bitset does not set valid bits correctly
• ARROW-3580 - [Gandiva][C++] Build error with g++ 8.2.0
• ARROW-3586 - [Python] Segmentation fault when converting empty table to pandas with categoricals
• ARROW-3598 - [Plasma] plasma_store_server fails linking with GPU enabled
• ARROW-3613 - [Go] Resize does not correctly update the length
• ARROW-3614 - [R] Handle Type::TIMESTAMP from Arrow to R
• ARROW-3658 - [Rust] validation of offsets buffer is incorrect for `List`
• ARROW-3670 - [C++] Use FindBacktrace to find execinfo.h support
• ARROW-3687 - [Rust] Anything measuring array slots should be `usize`
• ARROW-3698 - [C++] Segmentation fault when using a large table in Gandiva
• ARROW-3700 - [C++] CSV parser should allow ignoring empty lines
• ARROW-3703 - [Python] DataFrame.to_parquet crashes if datetime column has time zones
• ARROW-3707 - [C++] test failure with zstd 1.3.7
• ARROW-3711 - [C++] Don't pass CXX_FLAGS to C_FLAGS
• ARROW-3712 - [CI] License check regression (RAT failure)
• ARROW-3715 - [C++] gflags_ep fails to build with CMake 3.13
• ARROW-3716 - [R] Missing cases for ChunkedArray conversion
• ARROW-3728 - [Python] Merging Parquet Files - Pandas Meta in Schema Mismatch
• ARROW-3734 - [C++] Linking static zstd library fails on Arch x86-64
• ARROW-3740 - [C++] Calling ArrayBuilder::Resize with length smaller than current appended length results in invalid state
• ARROW-3742 - Fix pyarrow.types & gandiva cython bindings
• ARROW-3745 - [C++] CMake passes static libraries multiple times to linker
• ARROW-3754 - [Packaging] Zstd configure error on linux package builds
• ARROW-3756 - [CI/Docker/Java] Java tests are failing in docker-compose setup
• ARROW-3762 - [C++] Parquet arrow::Table reads error when overflowing capacity of BinaryArray
• ARROW-3765 - [Gandiva] Segfault when the validity bitmap has not been allocated
• ARROW-3766 - [Python] pa.Table.from_pandas doesn't use schema ordering
• ARROW-3768 - [Python] set classpath to hdfs not hadoop executable
• ARROW-3790 - [C++] Signed to unsigned integer cast yields incorrect results when type sizes are the same
• ARROW-3792 - [Python] Segmentation fault when writing empty RecordBatches to Parquet
• ARROW-3793 - [C++] TestScalarAppendUnsafe is not testing unsafe appends
• ARROW-3797 - [Rust] BinaryArray::value_offset incorrect in offset case
• ARROW-3805 - [Gandiva] handle null validity bitmap in if-else expressions
• ARROW-3831 - [C++] arrow::util::Codec::Decompress() doesn't return decompressed data size
• ARROW-3835 - [C++] arrow::io::CompressedOutputStream::raw() impementation is missing
• ARROW-3837 - [C++] gflags link errors on Windows
• ARROW-3866 - [Python] Column metadata is not transferred to tables in pyarrow
• ARROW-3874 - [Gandiva] Cannot build: LLVM not detected correctly
• ARROW-3879 - [C++] cuda-test failure
• ARROW-3888 - [C++] Compilation warnings with gcc 7.3.0
• ARROW-3889 - [Python] creating schema with invalid paramaters causes segmanetation fault
• ARROW-3890 - [Python] Creating Array with explicit string type fails on Python 2.7
• ARROW-3894 - [Python] Error reading IPC file with no record batches
• ARROW-3898 - parquet-arrow example has compilation errors
• ARROW-3920 - Plasma reference counting not properly done in TensorFlow custom operator.
• ARROW-3931 - Make possible to build regardless of LANG
• ARROW-3936 - Add _O_NOINHERIT to the file open flags on Windows
• ARROW-3937 - [Rust] Rust nightly build is failing
• ARROW-3940 - [Python/Documentation] Add required packages to the development instruction
• ARROW-3941 - [R] RecordBatchStreamReader$schema
• ARROW-3942 - [R] Feather api fixes
• ARROW-3953 - Compat with pandas 0.24 rename of MultiIndex labels -> codes
• ARROW-3955 - [GLib] Add (transfer full) to free when no longer needed
• ARROW-3957 - [Python] Better error message when user connects to HDFS cluster with wrong port
• ARROW-3961 - [Python/Documentation] Fix wrong path in the pyarrow README
• ARROW-3969 - [Rust] CI build broken because rustfmt not available on nightly toolchain
• ARROW-3976 - [Ruby] Homebrew donation solicitation on CLI breaking CI builds
• ARROW-3977 - [Gandiva] gandiva cpp tests not running in CI
• ARROW-3979 - [Gandiva] fix all valgrind reported errors
• ARROW-3980 - [C++] Fix CRTP use in json-simple.cc
• ARROW-3989 - [Rust] CSV reader should handle case sensitivity for boolean values
• ARROW-3996 - [C++] Insufficient description on build
• ARROW-4008 - [C++] Integration test executable failure
• ARROW-4011 - [Gandiva] Refer irhelpers.bc in build directory
• ARROW-4019 - [C++] Fix coverity issues
• ARROW-4033 - [C++] thirdparty/download_dependencies.sh uses tools or options not available in older Linuxes
• ARROW-4034 - [Ruby] Interface for FileOutputStream doesn't respect append=True
• ARROW-4041 - [CI] Python 2.7 run uses Python 3.6
• ARROW-4049 - [C++] Arrow never use glog even though glog is linked.
• ARROW-4052 - [C++] Linker errors with glog and gflags
• ARROW-4053 - [Python/Integration] HDFS Tests failing with I/O operation on closed file
• ARROW-4055 - [Python] Fails to convert pytz.utc with versions 2018.3 and earlier
• ARROW-4058 - [C++] arrow-io-hdfs-test fails when run against HDFS cluster from docker-compose
• ARROW-4065 - [C++] arrowTargets.cmake is broken
• ARROW-4066 - Instructions to create Sphinx documentation
• ARROW-4070 - [C++] ARROW_BOOST_VENDORED doesn't work properly with ninja build
• ARROW-4073 - [Python] Parquet test failures on AppVeyor
• ARROW-4074 - [Python] test_get_library_dirs_win32 fails if libraries installed someplace different from conda or wheel packages
• ARROW-4078 - [CI] Run Travis job where documentation is built when docs/ is changed
• ARROW-4088 - [Python] Table.from_batches() fails when passed a schema with metadata
• ARROW-4089 - [Plasma] The tutorial is wrong regarding the parameter type of PlasmaClient.Create
• ARROW-4101 - [C++] Binary identity cast not implemented
• ARROW-4106 - [Python] Tests fail to run because hypothesis update broke its API
• ARROW-4109 - [Packaging] Missing glog dependency from arrow-cpp conda recipe
• ARROW-4113 - [R] Version number patch broke build
• ARROW-4114 - [C++][DOCUMENTATION]
• ARROW-4115 - [Gandiva] valgrind complains that boolean output data buffer has uninited data
• ARROW-4118 - [Python] Error with "asv run"
• ARROW-4125 - [Python] ASV benchmarks fail to run if Plasma extension is not built (e.g. on Windows)
• ARROW-4126 - [Go] offset not used when accessing boolean array
• ARROW-4128 - [C++][DOCUMENTATION] Update style guide to reflect some more exceptions
• ARROW-4130 - [Go] offset not used when accessing binary array
• ARROW-4134 - [Packaging] Properly setup timezone in docker tests to prevent ORC adapter's abort
• ARROW-4135 - [Python] Can't reload a pandas dataframe containing a list of datetime.time
• ARROW-4138 - [Python] setuptools_scm customization does not work for versions above 0.9.0 on Windows
• ARROW-4147 - [JAVA] Reduce heap usage for variable width vectors
• ARROW-4149 - [CI/C++] Parquet test misses ZSTD compression codec in CMake 3.2 nightly builds
• ARROW-4157 - [C++] -Wdocumentation failures with clang 6.0 on Ubuntu 18.04
• ARROW-4171 - [Rust] fix parquet crate release version
• ARROW-4173 - JIRA library name is wrong in error message of dev/merge_arrow_pr.py
• ARROW-4178 - [C++] Fix TSan and UBSan errors
• ARROW-4179 - [Python] Tests crashing on all platforms in CI
• ARROW-4185 - [Rust] Appveyor builds are broken
• ARROW-4186 - [C++] BitmapWriters clobber the first byte when length=0
• ARROW-4188 - [Rust] There should be a README in the top level rust directory
• ARROW-4197 - [C++] Emscripten compiler fails building Arrow
• ARROW-4200 - [C++] conda_env_* files cannot be used to create a fresh conda environment on Windows
• ARROW-4209 - [Gandiva] returning IR structs causes issues with windows
• ARROW-4215 - [GLib] Fix typos in documentation
• ARROW-4227 - [GLib] Field in composite data type returns wrong data type
• ARROW-4237 - [Packaging] Fix CMAKE_INSTALL_LIBDIR in release verification script
• ARROW-4238 - [Packaging] Fix RC version conflict between crossbow and rake
• ARROW-4246 - [Plasma][Python] PlasmaClient.list doesn't work with CUDA enabled Plasma
• ARROW-4256 - [Release] Update Windows verification script for 0.12 release
• ARROW-4258 - [Python] Safe cast fails from numpy float64 array with nans to integer
• ARROW-4260 - [Python] test_serialize_deserialize_pandas is failing in multiple build entries

Improvement

• ARROW-1423 - [C++] Create non-owned CudaContext from context handle provided by thirdparty user
• ARROW-1688 - [Java] Fail build on checkstyle warnings
• ARROW-1993 - [Python] Add function for determining implied Arrow schema from pandas.DataFrame
• ARROW-2211 - [C++] Use simpler hash functions for integers
• ARROW-2216 - [CI] CI descriptions and envars are misleading
• ARROW-2475 - [Format] Confusing array length description
• ARROW-2483 - [Rust] use bit-packing for boolean vectors
• ARROW-2504 - [Website] Add ApacheCon NA link
• ARROW-2624 - [Python] Random schema and data generator for Arrow conversion and Parquet testing
• ARROW-2637 - [C++/Python] Build support and instructions for development on Alpine Linux
• ARROW-2670 - [C++/Python] Add Ubuntu 18.04 / gcc7 as a nightly build
• ARROW-2673 - [Python] Add documentation + docstring for ARROW-2661
• ARROW-2684 - [Python] Various documentation improvements
• ARROW-2759 - Export notification socket of Plasma
• ARROW-2803 - [C++] Put hashing function into src/arrow/util
• ARROW-2807 - [Python] Enable memory-mapping to be toggled in get_reader when reading Parquet files
• ARROW-2808 - [Python] Add unit tests for ProxyMemoryPool, enable new default MemoryPool to be constructed
• ARROW-2919 - [C++] Improve error message when listing empty HDFS file
• ARROW-2968 - [R] Multi-threaded conversion from Arrow table to R data.frame
• ARROW-3038 - [Go] add support for StringArray
• ARROW-3063 - [Go] move list of supported/TODO features to confluence
• ARROW-3070 - [Release] Host binary artifacts for RCs and releases on ASF Bintray account instead of dist/mirror system
• ARROW-3131 - [Go] add test for Go-1.11
• ARROW-3161 - [Packaging] Ensure to run pyarrow unit tests in conda and wheel builds
• ARROW-3169 - [C++] Break array-test.cc and array.cc into multiple compilation units
• ARROW-3199 - [Plasma] Check for EAGAIN in recvmsg and sendmsg
• ARROW-3209 - [C++] Rename libarrow_gpu to libarrow_cuda
• ARROW-3230 - [Python] Missing comparisons on ChunkedArray, Table
• ARROW-3233 - [Python] Sphinx documentation for pyarrow.cuda GPU support
• ARROW-3278 - [Python] Retrieve StructType's and StructArray's field by name
• ARROW-3291 - [C++] Convenience API for constructing arrow::io::BufferReader from std::string
• ARROW-3312 - [R] Use same .clang-format file for both R binding C++ code and main C++ codebase
• ARROW-3318 - [C++] Convenience method for reading all batches from an IPC stream or file as arrow::Table
• ARROW-3331 - [C++] Add re2 to ThirdpartyToolchain
• ARROW-3353 - [Packaging] Build python 3.7 wheels
• ARROW-3358 - [Gandiva][C++] Replace usages of gandiva/status.h with arrow/status.h
• ARROW-3362 - [R] Guard against null buffers
• ARROW-3366 - [R] Dockerfile for docker-compose setup
• ARROW-3368 - [Integration/CI/Python] Add dask integration test to docker-compose setup
• ARROW-3402 - [Gandiva][C++] Utilize common bitmap operation implementations in precompiled IR routines
• ARROW-3409 - [C++] Add streaming compression interfaces
• ARROW-3421 - [C++] Add include-what-you-use setup to primary docker-compose.yml
• ARROW-3429 - [Packaging] Add a script to release binaries that use source archive at dist.apache.orgtable bit
• ARROW-3430 - [Packaging] Add workaround to verify 0.11.0
• ARROW-3431 - [GLib] Include Gemfile to archive
• ARROW-3432 - [Packaging] Variables aren't expanded Subversion commit message
• ARROW-3440 - [Gandiva][C++] Remove outdated cpp/src/gandiva/README.md, add build documentation to cpp/README.md
• ARROW-3441 - [Gandiva][C++] Produce fewer test executables
• ARROW-3442 - [C++] Use dynamic linking for unit tests, ensure coverage working properly with clang
• ARROW-3451 - [Python] Allocate CUDA memory from a CUcontext created by numba.cuda
• ARROW-3455 - [Gandiva][C++] Support pkg-config for Gandiva
• ARROW-3456 - [CI] Reuse docker images and optimize docker-compose containers
• ARROW-3460 - [Packaging] Add a script to rebase master on local release branch
• ARROW-3461 - [Packaging] Add a script to upload RC artifacts as the official release
• ARROW-3462 - [Packaging] Update CHANGELOG for 0.11.0
• ARROW-3463 - [Website] Update for 0.11.0
• ARROW-3465 - [Documentation] Fix gen_apidocs' docker image
• ARROW-3473 - [Format] Update Layout.md document to clarify use of 64-bit array lengths
• ARROW-3474 - [GLib] Extend gparquet API with get_schema and read_column
• ARROW-3479 - [R] Support to write record_batch as stream
• ARROW-3482 - [C++] Build with JEMALLOC by default
• ARROW-3488 - [Packaging] Separate crossbow task definition files for packaging and tests
• ARROW-3492 - [C++] Build jemalloc in parallel
• ARROW-3493 - [Java] Document BOUNDS_CHECKING_ENABLED
• ARROW-3506 - [Packaging] Nightly tests for docker-compose images
• ARROW-3518 - [C++] Detect HOMEBREW_PREFIX automatically
• ARROW-3521 - [GLib] Run Python using find_program in meson.build
• ARROW-3530 - [Java/Python] Add conversion for pyarrow.Schema from org.apache…pojo.Schema
• ARROW-3533 - [Python/Documentation] Use sphinx_rtd_theme instead of Bootstrap
• ARROW-3539 - [CI/Packaging] Update scripts to build against vendored jemalloc
• ARROW-3542 - [C++] Use unsafe appends when building array from CSV
• ARROW-3545 - [C++/Python] Normalize child/field terminology with StructType
• ARROW-3547 - [R] Protect against Null crash when reading from RecordBatch
• ARROW-3548 - Speed up storing small objects in the object store.
• ARROW-3551 - Change MapD to OmniSci on Powered By page
• ARROW-3556 - [CI] Disable optimizations on Windows
• ARROW-3557 - [Python] Set language_level in Cython sources
• ARROW-3558 - [Plasma] Remove fatal error when plasma client calls get on an unsealed object that it created.
• ARROW-3559 - Statically link libraries for plasma_store_server executable.
• ARROW-3562 - [R] Disallow creation of objects with null shared_ptr
• ARROW-3563 - [C++] Declare public link dependencies so arrow_static, plasma_static automatically pull in transitive dependencies
• ARROW-3566 - Clarify that the type of dictionary encoded field should be the encoded(index) type
• ARROW-3574 - Fix remaining bug with plasma static versus shared libraries.
• ARROW-3576 - [Python] Expose compressed file readers as NativeFile
• ARROW-3577 - [Go] add support for ChunkedArray
• ARROW-3581 - [Gandiva][C++] ARROW_PROTOBUF_USE_SHARED isn't used
• ARROW-3582 - [CI] Gandiva C++ build is always triggered
• ARROW-3584 - [Go] add support for Table
• ARROW-3587 - [Python] Efficient serialization for Arrow Objects (array, table, tensor, etc)
• ARROW-3589 - [Gandiva] Make it possible to compile gandiva without JNI
• ARROW-3591 - [R] Support to collect decimal type
• ARROW-3600 - [Packaging] Support Ubuntu 18.10
• ARROW-3601 - [Rust] Release 0.11.0
• ARROW-3602 - [Gandiva] [Python] Add preliminary Cython bindings for Gandiva
• ARROW-3603 - [Gandiva][C++] Can't build with vendored Boost
• ARROW-3605 - Remove AE library from plasma header files.
• ARROW-3607 - [Java] delete() method via JNI for plasma
• ARROW-3611 - Give error more quickly when pyarrow serialization context is used incorrectly.
• ARROW-3612 - [Go] implement RecordBatch and RecordBatchReader
• ARROW-3615 - [R] Support for NaN
• ARROW-3618 - [Packaging/Documentation] Add `-c conda-forge` option to avoid PackagesNotFoundError
• ARROW-3620 - [Python] Document multithreading options in Sphinx and add to api.rst
• ARROW-3621 - [Go] implement TableBatchReader
• ARROW-3622 - [Go] implement Schema.Equal
• ARROW-3623 - [Go] implement Field.Equal
• ARROW-3624 - [Python/C++] Support for zero-sized device buffers
• ARROW-3626 - [Go] add a CSV TableReader
• ARROW-3629 - [Python] Add write_to_dataset to Python Sphinx API listing
• ARROW-3632 - [Packaging] Update deb names in dev/tasks/tasks.yml in dev/release/00-prepare.sh
• ARROW-3633 - [Packaging] Update deb names in dev/tasks/tasks.yml for 0.12.0
• ARROW-3634 - [GLib] cuda.cpp compile error
• ARROW-3636 - [C++/Python] Update arrow/python/pyarrow_api.h
• ARROW-3638 - [C++][Python] Move reading from Feather as Table feature to C++ from Python
• ARROW-3639 - [Packaging] Run gandiva nightly packaging tasks
• ARROW-3640 - [Go] add support for Tensors
• ARROW-3641 - [C++/Python] remove public keyword from Cython api functions
• ARROW-3642 - [C++] Add arrowConfig.cmake generation
• ARROW-3645 - [Python] Document compression support in Sphinx
• ARROW-3646 - [Python] Add convenience factories to create IO streams
• ARROW-3647 - [R] Crash after unloading bit64 package
• ARROW-3648 - [Plasma] Add API to get metadata and data at the same time
• ARROW-3649 - [Rust] Refactor MutableBuffer's resize
• ARROW-3656 - [C++] Allow whitespace in numeric CSV fields
• ARROW-3657 - [R] Require bit64 package
• ARROW-3659 - [C++] Clang Travis build (matrix entry 2) might not actually be using clang
• ARROW-3661 - [Gandiva][GLib] Improve constant name
• ARROW-3666 - [C++] Improve CSV parser performance
• ARROW-3672 - [Go] implement Time32 array
• ARROW-3673 - [Go] implement Time64 array
• ARROW-3674 - [Go] implement Date32 array
• ARROW-3675 - [Go] implement Date64 array
• ARROW-3677 - [Go] implement FixedSizedBinary array
• ARROW-3681 - [Go] add benchmarks for CSV reader
• ARROW-3682 - [Go] unexport encoding/csv.Reader from CSV reader
• ARROW-3683 - [Go] add functional-option style to CSV reader
• ARROW-3684 - [Go] add chunk size option to CSV reader
• ARROW-3693 - [R] Invalid buffer for empty characters with null data
• ARROW-3694 - [Java] Avoid superfluous string creation when logging level is disabled
• ARROW-3695 - [Gandiva] Use add_arrow_lib()
• ARROW-3696 - [C++] Add feather::TableWriter::Write(table)
• ARROW-3697 - [Ruby] Add schema#[]
• ARROW-3704 - [Gandiva] Can't build with g++ 8.2.0
• ARROW-3708 - [Packaging] Nightly CentOS builds are failing
• ARROW-3718 - [Gandiva] Remove spurious gtest include
• ARROW-3719 - [GLib] Support read/write tabl to/from Feather
• ARROW-3720 - [GLib] Use "indices" instead of "indexes"
• ARROW-3721 - [Gandiva] [Python] Support all Gandiva literals
• ARROW-3722 - [C++] Allow specifying column types to CSV reader
• ARROW-3724 - [GLib] Update gitignore
• ARROW-3725 - [GLib] Add field readers to GArrowStructDataType
• ARROW-3727 - [Python] Document use of pyarrow.foreign_buffer, cuda.foreign_buffer in Sphinx
• ARROW-3733 - [GLib] Add to_string() to GArrowTable and GArrowColumn
• ARROW-3736 - [CI/Docker] Ninja test in docker-compose run cpp hangs
• ARROW-3743 - [Ruby] Add support for saving/loading Feather
• ARROW-3744 - [Ruby] Use garrow_table_to_string() in Arrow::Table#to_s
• ARROW-3746 - [Gandiva] [Python] Make it possible to list all functions registered with Gandiva
• ARROW-3747 - [C++] Flip order of data members in arrow::Decimal128
• ARROW-3748 - [GLib] Add GArrowCSVReader
• ARROW-3749 - [GLib] Typos in documentation and test case name
• ARROW-3751 - [Python] Add more cython bindings for gandiva
• ARROW-3752 - [C++] Remove unused status::ArrowError
• ARROW-3753 - [Gandiva] Remove debug print
• ARROW-3773 - [C++] Remove duplicated AssertArraysEqual code in parquet/arrow/arrow-reader-writer-test.cc
• ARROW-3778 - [C++] Don't put implementations in test-util.h
• ARROW-3781 - [C++] Configure buffer size in arrow::io::BufferedOutputStream
• ARROW-3784 - [R] Array with type fails with x is not a vector
• ARROW-3785 - [C++] Use double-conversion conda package in CI toolchain
• ARROW-3787 - Implement From for BinaryArray
• ARROW-3788 - [Ruby] Add support for CSV parser writtin in C++
• ARROW-3795 - [R] Support for retrieving NAs from INT64 arrays
• ARROW-3796 - [Rust] Add Example for PrimitiveArrayBuilder
• ARROW-3800 - [C++] Vendor a string_view backport
• ARROW-3803 - [C++/Python] Split C++ and Python unit test Travis CI jobs, run all C++ tests (including Gandiva) together
• ARROW-3819 - [Packaging] Update conda variant files to conform with feedstock after compiler migration
• ARROW-3821 - [Format/Documentation]: Fix typos and grammar issues in Flight.proto comments
• ARROW-3825 - [Python] The Python README.md does not show how to run the unit test suite
• ARROW-3834 - [Doc] Merge Python & C++ and move to top-level
• ARROW-3836 - [C++] Add PREFIX option to ADD_ARROW_BENCHMARK
• ARROW-3839 - [Rust] Add ability to infer schema in CSV reader
• ARROW-3841 - [C++] warning: catching polymorphic type by value
• ARROW-3845 - [Gandiva] [GLib] Add GGandivaNode
• ARROW-3847 - [GLib] Remove unnecessary “\”.
• ARROW-3849 - Leverage Armv8 crc32 extension instructions to accelerate the hash computation for Arm64.
• ARROW-3852 - [C++] used uninitialized warning
• ARROW-3853 - [C++] Implement string to timestamp cast
• ARROW-3854 - [GLib] Deprecate garrow_gio_{input,output}_stream_get_raw()
• ARROW-3855 - [Rust] Schema/Field/Datatype should implement serde traits
• ARROW-3856 - [Ruby] Support compressed CSV save/load
• ARROW-3858 - [GLib] Use {class_name}_get_instance_private
• ARROW-3862 - [C++] Improve dependencies download script
• ARROW-3863 - [GLib] Use travis_retry with brew bundle command
• ARROW-3865 - [Packaging] Add double-conversion dependency to conda forge recipes and the windows wheel build
• ARROW-3868 - [Rust] Build against nightly Rust in CI
• ARROW-3870 - [C++] Add Peek to InputStream API
• ARROW-3871 - [R] Replace usages of C++ GetValuesSafely with new methods on ArrayData
• ARROW-3878 - [Rust] Improve primitive types
• ARROW-3880 - [Rust] PrimitiveArray should support simple math operations
• ARROW-3883 - [Rust] Update Rust README to reflect new functionality
• ARROW-3884 - [Python] Add LLVM6 to manylinux1 base image
• ARROW-3885 - [Rust] Update version to 0.12.0 and update release instructions on wiki
• ARROW-3886 - [C++] Additional test cases for ARROW-3831
• ARROW-3893 - [C++] Improve adaptive int builder performance
• ARROW-3895 - [Rust] CSV reader should return Result<Option<>> not Option<Result<>>
• ARROW-3905 - [Ruby] Add StructDataType#[]
• ARROW-3906 - [C++] Break builder.cc into multiple compilation units
• ARROW-3908 - [Rust] Update rust dockerfile to use nightly toolchain
• ARROW-3910 - [Python] Set date_as_object to True in *.to_pandas as default after deduplicating logic implemented
• ARROW-3911 - [Python] Deduplicate datetime.date objects in Table.to_pandas internals
• ARROW-3913 - [Gandiva] [GLib] Add GGandivaLiteralNode
• ARROW-3914 - [C++/Python/Packaging] Docker-compose setup for Alpine linux
• ARROW-3922 - [C++] improve the performance of bitmap operations
• ARROW-3925 - [Python] Include autoconf in Linux/macOS dependencies in conda environment
• ARROW-3928 - [Python] Add option to deduplicate PyBytes / PyString / PyUnicode objects in Table.to_pandas conversion path
• ARROW-3929 - [Go] improve memory usage of CSV reader to improve runtime performances
• ARROW-3930 - [C++] Random test data generation is slow
• ARROW-3932 - [Python/Documentation] Include Benchmarks.md in Sphinx docs
• ARROW-3934 - [Gandiva] Don't compile precompiled tests if ARROW_GANDIVA_BUILD_TESTS=off
• ARROW-3950 - [Plasma] Don't force loading the TensorFlow op on import
• ARROW-3952 - [Rust] Specify edition="2018" in Cargo.toml
• ARROW-3958 - [Plasma] Reduce number of IPCs
• ARROW-3960 - [Rust] remove extern crate for Rust 2018
• ARROW-3963 - [Packaging/Docker] Nightly test for building sphinx documentations
• ARROW-3964 - [Go] More readable example for csv.Reader
• ARROW-3967 - [Gandiva] [C++] Make gandiva/node.h public
• ARROW-3971 - [Python] Remove APIs deprecated in 0.11 and prior
• ARROW-3974 - [C++] Combine field_builders_ and children_ members in array/builder.h
• ARROW-3982 - [C++] Allow "binary" input in simple JSON format
• ARROW-3984 - [C++] Exit with error if user hits zstd ExternalProject path
• ARROW-3986 - [C++] Write prose documentation
• ARROW-3988 - [C++] Do not build unit tests by default in build system
• ARROW-3994 - [C++] Remove ARROW_GANDIVA_BUILD_TESTS option
• ARROW-3995 - [CI] Use understandable names in Travis Matrix
• ARROW-3997 - [C++] [Doc] Clarify dictionary encoding integer signedness (and width?)
• ARROW-4002 - [C++][Gandiva] Remove CMake version check
• ARROW-4004 - [GLib] Replace GPU with CUDA
• ARROW-4005 - [Plasma] [GLib] Add gplasma_client_disconnect()
• ARROW-4006 - Add CODE_OF_CONDUCT.md
• ARROW-4009 - [CI] Run Valgrind and C++ code coverage in different bulds
• ARROW-4015 - [Plasma] remove legacy interfaces for plasma manager
• ARROW-4017 - [C++] Check and update vendored libraries
• ARROW-4026 - [C++] Use separate modular $COMPONENT-test targets for unit tests
• ARROW-4029 - [C++] Define and document naming convention for internal / private header files not to be installed
• ARROW-4030 - [CI] Use travis_terminate to halt builds when a step fails
• ARROW-4035 - [Ruby] Support msys2 mingw dependencies
• ARROW-4037 - [Packaging] Remove workaround to verify 0.11.0
• ARROW-4038 - [Rust] Add array_ops methods for boolean AND, OR, NOT
• ARROW-4042 - [Rust] Inconsistent method naming between BinaryArray and PrimitiveArray
• ARROW-4048 - [GLib] Return ChunkedArray instead of Array in gparquet_arrow_file_reader_read_column
• ARROW-4051 - [Gandiva] [GLib] Add support for null literal
• ARROW-4054 - [Python] Update gtest, flatbuffers and OpenSSL in manylinux1 base image
• ARROW-4069 - [Python] Add tests for casting from binary to utf8
• ARROW-4080 - [Rust] Improving lengthy build times in Appveyor
• ARROW-4082 - [C++] CMake tweaks: allow RelWithDebInfo, improve FindClangTools
• ARROW-4084 - [C++] Simplify Status and stringstream boilerplate
• ARROW-4085 - [GLib] Use "field" for struct data type
• ARROW-4087 - [C++] Make CSV nulls configurable
• ARROW-4093 - [C++] Deprecated method suggests wrong method
• ARROW-4098 - [Python] Deprecate pyarrow.open_stream,open_file in favor of pa.ipc.open_stream/open_file
• ARROW-4102 - [C++] FixedSizeBinary identity cast not implemented
• ARROW-4103 - [Documentation] Add README to docs/ root
• ARROW-4105 - Add rust-toolchain to enforce user to use nightly toolchain for building
• ARROW-4107 - [Python] Use ninja in pyarrow manylinux1 build
• ARROW-4116 - [Python] Clarify in development.rst that virtualenv cannot be used with miniconda/Anaconda
• ARROW-4122 - [C++] Initialize some uninitialized class members
• ARROW-4127 - [Documentation] Add Docker build instructions
• ARROW-4129 - [Python] Fix syntax problem in benchmark docs
• ARROW-4152 - [GLib] Remove an example to show Torch integration
• ARROW-4155 - [Rust] Implement array_ops::sum() for PrimitiveArray
• ARROW-4158 - [Dev] Allow maintainers to use a GitHub API token when merging pull requests
• ARROW-4160 - [Rust] Add README and executable files to parquet
• ARROW-4168 - [GLib] Use property to keep GArrowDataType passed in garrow_field_new()
• ARROW-4177 - [C++] Add ThreadPool and TaskGroup microbenchmarks
• ARROW-4191 - [C++] Use same CC and AR for jemalloc as for the main sources
• ARROW-4199 - [GLib] Add garrow_seekable_input_stream_peek()
• ARROW-4207 - [Gandiva] [GLib] Add support for IfNode
• ARROW-4211 - [GLib] Add GArrowFixedSizeBinaryDataType
• ARROW-4216 - [Python] Add CUDA API docs
• ARROW-4228 - [GLib] Add garrow_list_data_type_get_field()
• ARROW-4229 - [Packaging] Set crossbow target explicitly to enable building arbitrary arrow repo
• ARROW-4233 - [Packaging] Create a Dockerfile to build source archive
• ARROW-4240 - [Packaging] Documents for Plasma GLib and Gandiva GLib are missing in source archive
• ARROW-4243 - [Python] Test failure with pandas 0.24.0rc1
• ARROW-4249 - [Plasma] Remove reference to logging.h from plasma/common.h
• ARROW-4257 - [Release] Update release verification script to check binaries on Bintray
• ARROW-4269 - [Python] AttributeError: module 'pandas.core' has no attribute 'arrays'
• ARROW-912 - [Python] Account for multiarch systems in development.rst

New Feature

• ARROW-1019 - [C++] Implement input stream and output stream with Gzip codec
• ARROW-1492 - [C++] Type casting function kernel suite
• ARROW-1696 - [C++] Add codec benchmarks
• ARROW-2712 - [C#] Initial C# .NET library
• ARROW-3020 - [Python] Addition of option to allow empty Parquet row groups
• ARROW-3108 - [C++] arrow::PrettyPrint for Table instances
• ARROW-3126 - [Python] Make Buffered* IO classes available to Python, incorporate into input_stream, output_stream factory functions
• ARROW-3184 - [C++] Add modular build targets, "all" target, and require explicit target when invoking make or ninja
• ARROW-3303 - [C++] Enable example arrays to be written with a simplified JSON representation
• ARROW-3306 - [R] Objects and support functions different kinds of arrow::Buffer
• ARROW-3307 - [R] Convert chunked arrow::Column to R vector
• ARROW-3310 - [R] Create wrapper classes for various Arrow IO interfaces
• ARROW-3340 - [R] support for dates and time classes
• ARROW-3355 - [R] Support for factors
• ARROW-3380 - [Python] Support reading CSV files and more from a gzipped file
• ARROW-3381 - [C++] Implement InputStream for bz2 files
• ARROW-3387 - [C++] Function to cast binary to string/utf8 with UTF8 validation
• ARROW-3398 - [Rust] Update existing Builder to use MutableBuffer internally
• ARROW-3407 - [C++] Add UTF8 conversion modes in CSV reader conversion options
• ARROW-3439 - [R] R language bindings for Feather format
• ARROW-3450 - [R] Wrap MemoryMappedFile class
• ARROW-3490 - [R] streaming arrow objects to output streams
• ARROW-3499 - [R] Expose arrow::ipc::Message type
• ARROW-3504 - [Plasma] Add support for Plasma Client to put/get raw bytes without pyarrow serialization.
• ARROW-3505 - [R] Read record batch and table
• ARROW-3515 - Introduce NumericTensor class
• ARROW-3529 - [Ruby] Import Red Parquet
• ARROW-3536 - [C++] Fast UTF8 validation functions
• ARROW-3537 - [Rust] Implement Tensor Type
• ARROW-3540 - [Rust] Incorporate BooleanArray into PrimitiveArray
• ARROW-3555 - [Plasma] Unify plasma client get function using metadata.
• ARROW-3567 - [Gandiva] [GLib] Add GLib bindings of Gandiva
• ARROW-3583 - [Python/Java] Create RecordBatch from VectorSchemaRoot
• ARROW-3592 - [Python] Get BinaryArray value as zero copy memory view
• ARROW-3608 - [R] Support for time32 and time64 array types
• ARROW-3610 - [C++] Add interface to turn stl_allocator into arrow::MemoryPool
• ARROW-3630 - [Plasma] [GLib] Add GLib bindings of Plasma
• ARROW-3660 - [C++] Don't unnecessarily lock MemoryMappedFile for resizing in readonly files
• ARROW-3662 - [C++] Add a const overload to MemoryMappedFile::GetSize
• ARROW-3692 - [Gandiva] [Ruby] Add Ruby bindings of Gandiva
• ARROW-3723 - [Plasma] [Ruby] Add Ruby bindings of Plasma
• ARROW-3726 - [Rust] CSV Reader & Writer
• ARROW-3731 - [R] R API for reading and writing Parquet files
• ARROW-3738 - [C++] Add CSV conversion option to parse ISO8601-like timestamp strings
• ARROW-3741 - [R] Add support for arrow::compute::Cast to convert Arrow arrays from one type to another
• ARROW-3755 - [GLib] Support for CompressedInputStream, CompressedOutputStream
• ARROW-3760 - [R] Support Arrow CSV reader
• ARROW-3782 - [C++] Implement BufferedReader for C++
• ARROW-3798 - [GLib] Add support for column type CSV read options
• ARROW-3807 - [R] Missing Field API
• ARROW-3823 - [R] + buffer.complex
• ARROW-3830 - [GLib] Add GArrowCodec
• ARROW-3842 - [R] RecordBatchStreamWriter api
• ARROW-3864 - [GLib] Add support for allow-float-truncate cast option
• ARROW-3900 - [GLib] Add garrow_mutable_buffer_set_data()
• ARROW-3912 - [Plasma][GLib] Add support for creating and referring objects
• ARROW-3916 - [Python] Support caller-provided filesystem in `ParquetWriter` constructor
• ARROW-3924 - [Packaging][Plasma] Add support for Plasma deb/rpm packages
• ARROW-3938 - [Packaging] Stop to refer java/pom.xml to get version information
• ARROW-3945 - [Website] Blog post about Gandiva code donation
• ARROW-3946 - [GLib] Add support for union
• ARROW-3959 - [Rust] Time and Timestamp Support
• ARROW-4028 - [Rust] Merge parquet-rs codebase
• ARROW-4112 - [Packaging][Gandiva] Add support for deb packages
• ARROW-4132 - [GLib] Add more GArrowTable constructors
• ARROW-4141 - [Ruby] Add support for creating schema from raw Ruby objects
• ARROW-4153 - [GLib] Add builder_append_value() for consistency
• ARROW-4154 - [GLib] Add GArrowDecimal128DataType
• ARROW-4161 - [GLib] Add GPlasmaClientOptions
• ARROW-4162 - [Ruby] Add support for creating data types from description
• ARROW-4166 - [Ruby] Add support for saving to and loading from buffer
• ARROW-4174 - [Ruby] Add support for building composite array from raw Ruby objects
• ARROW-4175 - [GLib] Add support for decimal compare operators
• ARROW-4183 - [Ruby] Add Arrow::Struct as an element of Arrow::StructArray
• ARROW-4184 - [Ruby] Add Arrow::RecordBatch#to_table
• ARROW-4214 - [Ruby] Add support for building RecordBatch from raw Ruby objects
• ARROW-45 - [Python] Add unnest/flatten function for List types
• ARROW-554 - [C++] Implement functions to conform unequal dictionaries amongst multiple Arrow arrays
• ARROW-854 - [Format] Support sparse tensor

Sub-task

• ARROW-3272 - [Java] Document checkstyle deviations from Google style guide
• ARROW-3273 - [Java] checkstyle - fix javadoc style
• ARROW-3323 - [Java] checkstyle - fix naming
• ARROW-3347 - [Rust] Implement PrimitiveArrayBuilder
• ARROW-3568 - [Packaging] Run pyarrow unittests for windows wheels
• ARROW-3569 - [Packaging] Run pyarrow unittests when building conda package
• ARROW-3588 - [Java] checkstyle - fix license
• ARROW-3616 - [Java] checkstyle - fix remaining coding checks
• ARROW-3664 - [Rust] Add benchmark for PrimitiveArrayBuilder
• ARROW-3665 - [Rust] Implement StructArrayBuilder
• ARROW-3713 - [Rust] Implement BinaryArrayBuilder
• ARROW-3891 - [Java] Remove Long.bitCount with simple bitmap operations
• ARROW-3939 - [Rust] Remove macro definition for ListArrayBuilder
• ARROW-3948 - [CI][GLib] Set timeout to Homebrew
• ARROW-4060 - [Rust] Add Parquet/Arrow schema converter
• ARROW-4075 - [Rust] Reuse array builder after calling finish()
• ARROW-4172 - [Rust] more consistent naming in array builders

Task

• ARROW-2337 - [Scripts] Windows release verification script should use boost DSOs instead of static linkage
• ARROW-2535 - [Python] Provide pre-commit hooks that check flake8
• ARROW-2560 - [Rust] The Rust README should include Rust-specific information on contributing
• ARROW-2653 - [C++] Refactor hash table support
• ARROW-2720 - [C++] Clean up cmake CXX_STANDARD and PIC flag setting
• ARROW-3194 - [Java] Fix setValueCount in spitAndTransfer for variable width vectors
• ARROW-3383 - [Java] Run Gandiva tests in Travis CI
• ARROW-3384 - [Gandiva] Sync remaining commits from gandiva repo
• ARROW-3385 - [Java] [Gandiva] Deploy gandiva snapshot jars automatically
• ARROW-3427 - [C++] Add Windows support, Unix static libs for double-conversion package in conda-forge
• ARROW-3469 - [Gandiva] add travis entry for gandiva on OSX
• ARROW-3472 - [Gandiva] remove gandiva helpers library
• ARROW-3487 - [Gandiva] simplify NULL_IF_NULL functions that can return errors
• ARROW-3489 - [Gandiva] Support for in expressions
• ARROW-3501 - [Gandiva] Enable building with gcc 4.8.x on Ubuntu Trusty, similar distros
• ARROW-3519 - [Gandiva] Add support for functions that can return variable len output
• ARROW-3597 - [Gandiva] gandiva should integrate with ADD_ARROW_TEST for tests
• ARROW-3609 - [Gandiva] Move benchmark tests out of unit test
• ARROW-3701 - [Gandiva] Add support for decimal operations
• ARROW-3859 - [Java] Fix ComplexWriter backward incompatible change
• ARROW-3860 - [Gandiva] [C++] Add option to use -static-libstdc++ when building libgandiva_jni.so
• ARROW-3867 - [Documentation] Uploading binary realase artifacts to Bintray
• ARROW-3970 - [Gandiva][C++] Remove unnecessary boost dependencies
• ARROW-3983 - [Gandiva][Crossbow] Use static boost while packaging
• ARROW-3993 - [JS] CI Jobs Failing
• ARROW-4039 - Update link to 'development.rst' page from Python README.md
• ARROW-4043 - [Packaging/Docker] Python tests on alpine miss pytest dependency
• ARROW-4044 - [Packaging/Python] Add hypothesis test dependency to pyarrow conda recipe
• ARROW-4045 - [Packaging/Python] Add hypothesis test dependency to wheel crossbow tests
• ARROW-4100 - [Gandiva][C++] Fix regex to ignore "." character
• ARROW-4148 - [CI/Python] Disable ORC on nightly Alpine builds
• ARROW-4151 - [Rust] Restructure project directories
• ARROW-4210 - [Python] Mention boost-cpp directly in the conda meta.yaml for pyarrow
• ARROW-4239 - [Release] Updating .deb package names in the prepare script failed to run on OSX
• ARROW-4241 - [Packaging] Disable crossbow conda OSX clang builds
• ARROW-4266 - [Python][CI] Disable ORC tests in dask integration test
• ARROW-4270 - [Packaging][Conda] Update xcode version and remove toolchain builds

Test

• ARROW-4137 - [Rust] Move parquet code into a separate crate

Wish

• ARROW-3248 - [C++] Arrow tests should have label "arrow"
• ARROW-3260 - [CI] Make linting a separate job
• ARROW-3844 - [C++] Remove ARROW_USE_SSE and ARROW_SSE3
• ARROW-3851 - [C++] "make check-format" is slow
• ARROW-4079 - [C++] Add machine benchmarks
• ARROW-4150 - [C++] Do not return buffers containing nullptr from internal allocations
• ARROW-4156 - [C++] xcodebuild failure for cmake generated project

Apache Arrow 0.11.0 (08 October 2018)

Bug

• ARROW-1380 - [C++] Fix "still reachable" valgrind warnings when PLASMA_VALGRIND=1
• ARROW-1661 - [Python] Python 3.7 support
• ARROW-1799 - [Plasma C++] Make unittest does not create plasma store executable
• ARROW-1996 - [Python] pyarrow.read_serialized cannot read concatenated records
• ARROW-2027 - [C++] ipc::Message::SerializeTo does not pad the message body
• ARROW-2220 - Change default fix version in merge tool to be the next mainline release version
• ARROW-2310 - Source release scripts fail with Java8
• ARROW-2646 - [C++/Python] Pandas roundtrip for date objects
• ARROW-2776 - [C++] Do not pass -Wno-noexcept-type for compilers that do not support it
• ARROW-2782 - [Python] Ongoing Travis CI failures in Plasma unit tests
• ARROW-2814 - [Python] Unify PyObject* sequence conversion paths for built-in sequences, NumPy arrays
• ARROW-2854 - [C++/Python] Casting float NaN to int should raise an error on safe cast
• ARROW-2925 - [JS] Documentation failing in docker container
• ARROW-2965 - [Python] Possible uint64 overflow issues in python_to_arrow.cc
• ARROW-2966 - [Python] Data type conversion error
• ARROW-2973 - [Python] pitrou/asv.git@customize_commands does not work with the "new" way of activating conda
• ARROW-2974 - [Python] Replace usages of "source activate" with "conda activate" in CI scripts
• ARROW-2986 - [C++] /EHsc possibly needed for Visual Studio 2015 builds
• ARROW-2992 - [Python] Parquet benchmark failure
• ARROW-3006 - [GLib] .gir/.typelib for GPU aren't installed
• ARROW-3007 - [Packaging] libarrow-gpu10 deb for Ubuntu 18.04 has broken dependencies
• ARROW-3011 - [CI] Remove Slack notification
• ARROW-3012 - [Python] Installation crashes with setuptools_scm error
• ARROW-3013 - [Website] Fix download links on website for tarballs, checksums
• ARROW-3015 - [Python] Fix documentation typo for pa.uint8
• ARROW-3047 - [C++] cmake downloads and builds ORC even though it's installed
• ARROW-3049 - [C++/Python] ORC reader fails on empty file
• ARROW-3053 - [Python] Pandas decimal conversion segfault
• ARROW-3056 - [Python] Indicate in NativeFile docstrings methods that are part of the RawIOBase API but not implemented
• ARROW-3061 - [Java] headroom does not take into account reservation
• ARROW-3065 - [Python] concat_tables() failing from bad Pandas Metadata
• ARROW-3083 - [Python] Version in manylinux1 wheel builds is wrong
• ARROW-3093 - [C++] Linking errors with ORC enabled
• ARROW-3095 - [Python] test_plasma.py fails
• ARROW-3098 - [Python] BufferReader doesn't adhere to the seek protocol
• ARROW-3100 - [CI] C/glib build broken on OS X
• ARROW-3125 - [Python] Update ASV instructions
• ARROW-3132 - Regenerate 0.10.0 changelog
• ARROW-3140 - [Plasma] Plasma fails building with GPU enabled
• ARROW-3141 - [Python] Tensorflow support in pyarrow wheels pins numpy>=1.14
• ARROW-3145 - [C++] Thrift compiler reruns in arrow/dbi/hiveserver2/thrift when using Ninja build
• ARROW-3173 - [Rust] dynamic_types example does not run
• ARROW-3175 - [Java] Upgrade to official FlatBuffers release (Flatbuffers incompatibility)
• ARROW-3183 - [Python] get_library_dirs on Windows can give the wrong directory
• ARROW-3188 - [Python] Table.from_arrays segfaults if lists and schema are passed
• ARROW-3190 - [C++] "WriteableFile" is misspelled, should be renamed "WritableFile" with deprecation for old name
• ARROW-3206 - [C++] Building with ARROW_HIVESERVER2=ON with unit tests disabled causes error
• ARROW-3227 - [Python] NativeFile.write shouldn't accept unicode strings
• ARROW-3228 - [Python] Immutability of bytes is ignored
• ARROW-3231 - [Python] Sphinx's autodoc_default_flags is now deprecated
• ARROW-3237 - [CI] Update linux packaging filenames in rat exclusion list
• ARROW-3241 - [Plasma] test_plasma_list test failure on Ubuntu 14.04
• ARROW-3251 - [C++] Conversion warnings in cast.cc
• ARROW-3256 - [JS] File footer and message metadata is inconsistent
• ARROW-3279 - [C++] Allow linking Arrow tests dynamically on Windows
• ARROW-3299 - [C++] Appveyor builds failing
• ARROW-3322 - [CI] Rust job always runs on AppVeyor
• ARROW-3327 - [Python] manylinux container confusing
• ARROW-3338 - [Python] Crash when schema and columns do not match
• ARROW-3342 - Appveyor builds have stopped triggering on GitHub
• ARROW-3348 - Plasma store dies when an object that a dead client is waiting for gets created.
• ARROW-3354 - [Python] read_record_batch interfaces differ in pyarrow and pyarrow.cuda
• ARROW-3369 - [Packaging] Wheel builds are failing due to wheel 0.32 release
• ARROW-3370 - [Packaging] Centos 6 build is failing
• ARROW-3373 - Fix bug in which plasma store can die when client gets multiple objects and object becomes available.
• ARROW-3374 - [Python] Dictionary has out-of-bound index when creating DictionaryArray from Pandas with NaN
• ARROW-3393 - [C++] Fix compiler warning in util/task-group-cc on clang 6
• ARROW-3394 - [Java] Remove duplicate dependency entry in Flight
• ARROW-3403 - [Website] Source tarball link missing from install page
• ARROW-3420 - [C++] Fix outstanding include-what-you-use issues in src/arrow, src/parquet codebases

Improvement

• ARROW-1521 - [C++] Add Reset method to BufferOutputStream to enable object reuse
• ARROW-1949 - [Python/C++] Add option to Array.from_pandas and pyarrow.array to perform unsafe casts
• ARROW-1963 - [C++/Python] Create Array from sequence of numpy.datetime64
• ARROW-1968 - [Python] Unit testing setup for ORC files
• ARROW-2165 - enhance AllocatorListener to listen for child allocator addition and removal
• ARROW-2520 - [Rust] CI should also build against nightly Rust
• ARROW-2555 - [Python] Provide an option to convert on coerce_timestamps instead of error
• ARROW-2583 - [Rust] Buffer should be typeless
• ARROW-2617 - [Rust] Schema should contain fields not columns
• ARROW-2687 - [JS] Example usage in README is outdated
• ARROW-2734 - [Python] Cython api example doesn't work by default on macOS
• ARROW-2799 - [Python] Add safe option to Table.from_pandas to avoid unsafe casts
• ARROW-2813 - [C++] Strip uninformative lcov output from Travis CI logs
• ARROW-2817 - [C++] Enable libraries to be installed in msys2 on Windows
• ARROW-2840 - [C++] See if stream alignment logic can be simplified
• ARROW-2865 - [C++/Python] Reduce some duplicated code in python/builtin_convert.cc
• ARROW-2889 - [C++] Add optional argument to ADD_ARROW_TEST CMake function to add unit test prefix
• ARROW-2900 - [Python] Improve performance of appending nested NumPy arrays in builtin_convert.cc
• ARROW-2936 - [Python] Implement Table.cast for casting from one schema to another (if possible)
• ARROW-2952 - [C++] Dockerfile for running include-what-you-use checks
• ARROW-2964 - [Go] wire all currently implemented array types in array.MakeFromData
• ARROW-2971 - [Python] Give more descriptive names to python_to_arrow.cc/arrow_to_python.cc
• ARROW-2975 - [Plasma] TensorFlow op: Compilation only working if arrow found by pkg-config
• ARROW-2976 - [Python] Directory in pyarrow.get_library_dirs() on Travis doesn't contain libarrow.so
• ARROW-2983 - [Packaging] Verify source release and binary artifacts in different scripts
• ARROW-2989 - [C++] Remove deprecated APIs in 0.10.0 and below
• ARROW-2994 - [C++] Only include Python C header directories for Python-related compilation units
• ARROW-2996 - [C++] Fix typo in cpp/.clang-tidy
• ARROW-2998 - [C++] Add variants of AllocateBuffer, AllocateResizeableBuffer that return unique_ptr
• ARROW-2999 - [Python] Do not run ASV benchmarks in every Travis CI build to improve runtimes
• ARROW-3000 - [Python] Do not build unit tests other than python-test in travis_script_python.sh
• ARROW-3005 - [Website] Update website and write blog post for 0.10.0 release announcement
• ARROW-3008 - [Packaging] Verify GPU related modules if available
• ARROW-3009 - [Python] pyarrow.orc uses APIs now prohibited in 0.10.0
• ARROW-3010 - [GLib] Update README to use Bundler
• ARROW-3017 - [C++] Don't throw exception in arrow/util/thread-pool.h
• ARROW-3018 - [Plasma] Improve random ObjectID generation
• ARROW-3019 - [Packaging] Use Bundler to verify Arrow GLib
• ARROW-3021 - [Go] support for List
• ARROW-3022 - [Go] support for Struct
• ARROW-3023 - [C++] Use gold linker in builds if it is available
• ARROW-3024 - [C++] Replace usages of std::mutex with atomics in memory_pool.cc
• ARROW-3026 - [Plasma] Only run Plasma Python unit tests under valgrind once instead of twice in CI
• ARROW-3027 - [Ruby] Stop "git tag" by "rake release"
• ARROW-3028 - [Python] Trim unneeded work from documentation build in Travis CI
• ARROW-3029 - [Python] pkg_resources is slow
• ARROW-3031 - [Go] Streamline release of Arrays and Builders
• ARROW-3034 - [Packaging] Source archive can't be extracted by bsdtar on MSYS2
• ARROW-3035 - [Rust] Examples in README.md do not run
• ARROW-3036 - [Go] add support for slicing Arrays
• ARROW-3037 - [Go] add support NullArray
• ARROW-3042 - [Go] add badge to GoDoc in the Go-Arrow README
• ARROW-3043 - [C++] pthread doesn't exist on MinGW
• ARROW-3044 - [Python] Remove all occurrences of cython's legacy property definition syntax
• ARROW-3046 - [GLib] Use rubyish method in test-orc-file-reader.rb
• ARROW-3062 - [Python] Extend fast libtensorflow_framework.so compatibility workaround to Python 2.7
• ARROW-3064 - [C++] Add option to ADD_ARROW_TEST to indicate additional dependencies for particular unit test executables
• ARROW-3067 - [Packaging] Support dev/rc/release .deb/.rpm builds
• ARROW-3068 - [Packaging] Bump version to 0.11.0-SNAPSHOT
• ARROW-3069 - [Release] Stop using SHA1 checksums per ASF policy
• ARROW-3072 - [C++] Use ARROW_RETURN_NOT_OK instead of RETURN_NOT_OK in header files
• ARROW-3076 - [Website] Add Google Analytics tags to C++, Python API docs
• ARROW-3088 - [Rust] Use internal `Result` type instead of `Result<T, ArrowError>`
• ARROW-3105 - [Plasma] Improve flushing error message
• ARROW-3106 - [Website] Update committers and PMC roster on website
• ARROW-3111 - [Java] Enable changing default logging level when running tests
• ARROW-3114 - [Website] Add information about user@ mailing list to website / Community page
• ARROW-3116 - [Plasma] Add "ls" to object store
• ARROW-3117 - [GLib] Add garrow_chunked_array_to_string()
• ARROW-3127 - [C++] Add Tutorial about Sending Tensor from C++ to Python
• ARROW-3128 - [C++] Support system shared zlib
• ARROW-3129 - [Packaging] Stop to use deprecated BuildRoot and Group in .rpm
• ARROW-3130 - [Go] add initial support for Go modules
• ARROW-3136 - [C++] Clean up arrow:: public API
• ARROW-3142 - [C++] Fetch all libs from toolchain environment
• ARROW-3143 - [C++] CopyBitmap into existing memory
• ARROW-3147 - [C++] MSVC version isn't detected in code page 932
• ARROW-3148 - [C++] MSVC shows C4819 warning on code page 932
• ARROW-3152 - [C++][Packaging] Use dynamic linking for zlib in conda recipes
• ARROW-3157 - [C++] Improve buffer creation for typed data
• ARROW-3158 - [C++] Handle float truncation during casting
• ARROW-3160 - [Python] Improve pathlib.Path support in parquet and filesystem modules
• ARROW-3163 - [Python] Cython dependency is missing in non wheel package
• ARROW-3167 - [CI] Limit clcache cache size
• ARROW-3170 - [C++] Implement "readahead spooler" class for background input buffering
• ARROW-3172 - [Rust] Update documentation for datatypes.rs
• ARROW-3174 - [Rust] run examples as part of CI
• ARROW-3177 - [Rust] Update expected error messages for tests that 'should panic'
• ARROW-3180 - [C++] Add docker-compose setup to simulate Travis CI run locally
• ARROW-3181 - [Packaging] Adjust conda package scripts to account for Parquet codebase migration
• ARROW-3195 - [C++] NumPy initialization error check is missing in test
• ARROW-3211 - [C++] gold linker doesn't work with MinGW-w64
• ARROW-3212 - [C++] Create deterministic IPC metadata
• ARROW-3213 - [C++] Use CMake to build vendored Snappy on Windows
• ARROW-3214 - [C++] Disable insecure warnings with MinGW build
• ARROW-3215 - [C++] Add support for finding libpython on MSYS2
• ARROW-3216 - [C++] libpython isn't linked to libarrow_python in MinGW build
• ARROW-3217 - [C++] ARROW_STATIC definition is missing in MinGW build
• ARROW-3218 - [C++] Utilities has needless pthread link in MinGW build
• ARROW-3219 - [C++] Use Win32 API in MinGW
• ARROW-3223 - [GLib] Use the same shared object versioning rule in C++
• ARROW-3229 - [Packaging]: Adjust wheel package scripts to account for Parquet codebase migration
• ARROW-3234 - [C++] Link order is wrong when ARROW_ORC=on and ARROW_PROTOBUF_USE_SHARED=ON
• ARROW-3235 - [Packaging] Update deb names
• ARROW-3236 - [C++] OutputStream bookkeeping logic when writing IPC file format is incorrect
• ARROW-3240 - [GLib] Add build instructions using Meson
• ARROW-3242 - [C++] Use coarser-grained dispatch to SIMD hash functions
• ARROW-3249 - [Python] Run flake8 on integration_test.py and crossbow.py
• ARROW-3252 - [C++] Do not hard code the "v" part of versions in thirdparty toolchain
• ARROW-3257 - [C++] Stop to use IMPORTED_LINK_INTERFACE_LIBRARIES
• ARROW-3258 - [GLib] CI is failued on macOS
• ARROW-3259 - [GLib] Rename "writeable" to "writable"
• ARROW-3261 - [Python] Add "field" method to select fields from StructArray
• ARROW-3262 - [Python] Implement __getitem__ with integers on pyarrow.Column
• ARROW-3267 - [Python] Create empty table from schema
• ARROW-3268 - [CI] Reduce conda times on AppVeyor
• ARROW-3269 - [Python] Fix warnings in unit test suite
• ARROW-3270 - [Release] Adjust release verification scripts to recent parquet migration
• ARROW-3274 - [Packaging] Missing glog dependency from conda-forge recipes
• ARROW-3276 - [Packaging] Add support Parquet related Linux packages
• ARROW-3281 - [Java] Make sure that WritableByteChannel in WriteChannel writes out complete bytes
• ARROW-3285 - [GLib] Add arrow_cpp_build_type and arrow_cpp_build_dir Meson options
• ARROW-3286 - [C++] ARROW_EXPORT for RecordBatchBuilder is missing
• ARROW-3287 - [C++] "redeclared without dllimport attribute after being referenced with dll linkage" with MinGW
• ARROW-3288 - [GLib] Add new API index for 0.11.0
• ARROW-3300 - [Release] Update .deb package names in preparation
• ARROW-3301 - [Website] Update Jekyll and Bootstrap 4
• ARROW-3305 - [JS] Incorrect development documentation link in javascript readme
• ARROW-3309 - [JS] Missing links from DEVELOP.md
• ARROW-3313 - [R] Run clang-format, cpplint checks on R C++ code
• ARROW-3319 - [GLib] Expose AlignStream methods in InputStream, OutputStream classes
• ARROW-3320 - [C++] Improve float parsing performance
• ARROW-3321 - [C++] Improve integer parsing performance
• ARROW-3334 - [Python] Update conda packages to new numpy requirement
• ARROW-3335 - [Python] Add ccache to manylinux1 container
• ARROW-3349 - [C++] Use aligned API in MinGW
• ARROW-3356 - [Python] Document parameters of Table.to_pandas method
• ARROW-3363 - [C++/Python] Add helper functions to detect scalar Python types
• ARROW-3375 - [Rust] Remove memory_pool.rs
• ARROW-3376 - [C++] Add double-conversion to cpp/thirdparty/download_dependencies.sh
• ARROW-3377 - [Gandiva][C++] Remove If statement from bit map set function
• ARROW-3392 - [Python] Support filters in disjunctive normal form in ParquetDataset
• ARROW-3395 - [C++/Python] Add docker container for linting
• ARROW-3397 - [C++] Use relative CMake path for modules
• ARROW-3400 - [Packaging] Add support Parquet GLib related Linux packages
• ARROW-3404 - [C++] Make CSV chunker faster
• ARROW-3411 - [Packaging] dev/release/01-perform.sh doesn't have executable bit
• ARROW-3412 - [Packaging] rat failure in dev/release/02-source.sh
• ARROW-3413 - [Packaging] dev/release/02-source.sh doesn't generate Parquet GLib document
• ARROW-3415 - [Packaging] dev/release/verify-release-cndidate.sh fails in "conda activate arrow-test"
• ARROW-3416 - [Packaging] dev/release/02-source.sh must use SHA512 instead of SHA1
• ARROW-3417 - [Packaging] dev/release/verify-release-cndidate.sh fails Parquet C++ test
• ARROW-3423 - [Packaging] Remove RC information from deb/rpm

New Feature

• ARROW-1325 - [R] Bootstrap R bindings subproject
• ARROW-1424 - [Python] Initial bindings for libarrow_gpu
• ARROW-1491 - [C++] Add casting implementations from strings to numbers or boolean
• ARROW-1563 - [C++] Implement logical unary and binary kernels for boolean arrays
• ARROW-1860 - [C++] Add data structure to "stage" a sequence of IPC messages from in-memory data
• ARROW-249 - [Flight] Define GRPC IDL / wire protocol for messaging with Arrow data
• ARROW-25 - [C++] Implement delimited file scanner / CSV reader
• ARROW-2750 - [MATLAB] Add MATLAB support for reading numeric types from Feather files
• ARROW-2979 - [GLib] Add operator functions in GArrowDecimal128
• ARROW-3050 - [C++] Adopt HiveServer2 client C++ codebase
• ARROW-3075 - [C++] Incorporate apache/parquet-cpp codebase into Arrow C++ codebase and build system
• ARROW-3090 - [Rust] Accompany error messages with assertions
• ARROW-3146 - [C++] Barebones Flight RPC server and client implementations
• ARROW-3182 - [C++] Merge Gandiva codebase
• ARROW-3187 - [Plasma] Make Plasma Log pluggable with glog
• ARROW-3196 - Enable merge_arrow_py.py script to merge Parquet patches and set fix versions
• ARROW-3197 - [C++] Add instructions to cpp/README.md about Parquet-only development and Arrow+Parquet
• ARROW-3250 - [C++] Create Buffer implementation that takes ownership for the memory from a std::string via std::move
• ARROW-3282 - [R] initial R functionality
• ARROW-3284 - [R] Adding R Error in Status
• ARROW-3339 - [R] Support for character vectors
• ARROW-3341 - [R] Support for logical vector
• ARROW-3360 - [GLib] Import Parquet bindings
• ARROW-3418 - [C++] Update Parquet snapshot version for release

Sub-task

• ARROW-2948 - [Packaging] Generate changelog with crossbow
• ARROW-3115 - [Java] Style Checks - Fix import ordering
• ARROW-3171 - [Java] checkstyle - fix line length and indentation
• ARROW-3264 - [Java] checkstyle - fix whitespace
• ARROW-3357 - [Rust] Add a mutable buffer implementation

Task

• ARROW-2338 - [Scripts] Windows release verification script should create a conda environment
• ARROW-2950 - [C++] Clean up util/bit-util.h
• ARROW-2958 - [C++] Flatbuffers EP fails to compile with GCC 8.1
• ARROW-2960 - [Packaging] Fix verify-release-candidate for binary packages and fix release cutting script for lib64 cmake issue
• ARROW-2991 - [CI] Cut down number of AppVeyor jobs
• ARROW-3001 - [Packaging] Don't modify PATH during rust release verification
• ARROW-3003 - [Doc] Enable Java doc in dev/gen_apidocs/create_documents.sh
• ARROW-3045 - [Python] Remove nullcheck from ipc Message and MessageReader
• ARROW-3057 - [INTEGRATION] Fix spark and hdfs dockerfiles
• ARROW-3059 - [C++] Streamline namespace array::test
• ARROW-3060 - [C++] Factor out parsing routines
• ARROW-3109 - [Python] Add Python 3.7 virtualenvs to manylinux1 container
• ARROW-3110 - [C++] Compilation warnings with gcc 7.3.0
• ARROW-3119 - [Packaging] Nightly packaging script fails
• ARROW-3153 - [Packaging] Fix broken nightly package builds introduced with recent cmake changes and orc tests
• ARROW-3350 - [Website] Fix powered by links
• ARROW-3352 - [Packaging] Fix recently failing wheel builds
• ARROW-3371 - [Python] Remove check_metadata argument for Field.equals docstring
• ARROW-3382 - [C++] Run Gandiva tests in Travis CI

Wish

• ARROW-3002 - [Python] Implement better DataType hash function
• ARROW-3094 - [Python] Allow lighter construction of pa.Schema / pa.StructType
• ARROW-3099 - [C++] Add benchmark for number parsing

Apache Arrow 0.10.0 (02 August 2018)

Bug

• ARROW-2059 - [Python] Possible performance regression in Feather read/write path
• ARROW-2101 - [Python] from_pandas reads 'str' type as binary Arrow data with Python 2
• ARROW-2122 - [Python] Pyarrow fails to serialize dataframe with timestamp.
• ARROW-2182 - [Python] ASV benchmark setup does not account for C++ library changing
• ARROW-2193 - [Plasma] plasma_store has runtime dependency on Boost shared libraries when ARROW_BOOST_USE_SHARED=on
• ARROW-2195 - [Plasma] Segfault when retrieving RecordBatch from plasma store
• ARROW-2247 - [Python] Statically-linking boost_regex in both libarrow and libparquet results in segfault
• ARROW-2273 - Cannot deserialize pandas SparseDataFrame
• ARROW-2300 - [Python] python/testing/test_hdfs.sh no longer works
• ARROW-2305 - [Python] Cython 0.25.2 compilation failure
• ARROW-2314 - [Python] Union array slicing is defective
• ARROW-2326 - [Python] cannot import pip installed pyarrow on OS X (10.9)
• ARROW-2328 - Writing a slice with feather ignores the offset
• ARROW-2331 - [Python] Fix indexing implementations
• ARROW-2333 - [Python] boost bundling fails in setup.py
• ARROW-2342 - [Python] Aware timestamp type fails pickling
• ARROW-2346 - [Python] PYARROW_CXXFLAGS doesn't accept multiple options
• ARROW-2349 - [Python] Boost shared library bundling is broken for MSVC
• ARROW-2351 - [C++] StringBuilder::append(vector...) not implemented
• ARROW-2354 - [C++] PyDecimal_Check() is much too slow
• ARROW-2355 - [Python] Unable to import pyarrow [0.9.0] OSX
• ARROW-2357 - Benchmark PandasObjectIsNull
• ARROW-2368 - DecimalVector#setBigEndian is not padding correctly for negative values
• ARROW-2369 - Large (>~20 GB) files written to Parquet via PyArrow are corrupted
• ARROW-2370 - [GLib] include path is wrong on Meson build
• ARROW-2371 - [GLib] gio-2.0 isn't required on GNU Autotools build
• ARROW-2372 - [Python] ArrowIOError: Invalid argument when reading Parquet file
• ARROW-2375 - [Rust] Buffer should release memory when dropped
• ARROW-2377 - [GLib] Travis-CI failures
• ARROW-2380 - [Python] Correct issues in numpy_to_arrow conversion routines
• ARROW-2382 - [Rust] List was not using memory safely
• ARROW-2383 - [C++] Debian packages need to depend on libprotobuf
• ARROW-2387 - [Python] negative decimal values get spurious rescaling error
• ARROW-2391 - [Python] Segmentation fault from PyArrow when mapping Pandas datetime column to pyarrow.date64
• ARROW-2393 - [C++] arrow/status.h does not define ARROW_CHECK needed for ARROW_CHECK_OK
• ARROW-2403 - [C++] arrow::CpuInfo::model_name_ destructed twice on exit
• ARROW-2405 - [C++] is missing in plasma/client.h
• ARROW-2418 - [Rust] List builder fails due to memory not being reserved correctly
• ARROW-2419 - [Site] Website generation depends on local timezone
• ARROW-2420 - [Rust] Memory is never released
• ARROW-2423 - [Python] PyArrow datatypes raise ValueError on equality checks against non-PyArrow objects
• ARROW-2424 - [Rust] Missing import causing broken build
• ARROW-2425 - [Rust] Array::from missing mapping for u8 type
• ARROW-2426 - [CI] glib build failure
• ARROW-2432 - [Python] from_pandas fails when converting decimals if have None values
• ARROW-2437 - [C++] Change of arrow::ipc::ReadMessage signature breaks ABI compability
• ARROW-2441 - [Rust] Builder::slice_mut assertions are too strict
• ARROW-2443 - [Python] Conversion from pandas of empty categorical fails with ArrowInvalid
• ARROW-2450 - [Python] Saving to parquet fails for empty lists
• ARROW-2452 - [TEST] Spark integration test fails with permission error
• ARROW-2454 - [Python] Empty chunked array slice crashes
• ARROW-2455 - [C++] The bytes_allocated_ in CudaContextImpl isn't initialized
• ARROW-2457 - garrow_array_builder_append_values() won't work for large arrays
• ARROW-2459 - pyarrow: Segfault with pyarrow.deserialize_pandas
• ARROW-2462 - [C++] Segfault when writing a parquet table containing a dictionary column from Record Batch Stream
• ARROW-2465 - [Plasma] plasma_store fails to find libarrow_gpu.so
• ARROW-2466 - [C++] misleading "append" flag to FileOutputStream
• ARROW-2468 - [Rust] Builder::slice_mut should take mut self
• ARROW-2471 - [Rust] Assertion when pushing value to Builder/ListBuilder with zero capacity
• ARROW-2473 - [Rust] List assertion error with list of zero length
• ARROW-2474 - [Rust] Add windows support for memory pool abstraction
• ARROW-2489 - [Plasma] test_plasma.py crashes
• ARROW-2491 - [Python] Array.from_buffers does not work for ListArray
• ARROW-2492 - [Python] Prevent segfault on accidental call of pyarrow.Array
• ARROW-2500 - [Java] IPC Writers/readers are not always setting validity bits correctly
• ARROW-2502 - [Rust] Restore Windows Compatibility
• ARROW-2503 - [Python] Trailing space character in RowGroup statistics of pyarrow.parquet.ParquetFile
• ARROW-2509 - [CI] Intermittent npm failures
• ARROW-2511 - BaseVariableWidthVector.allocateNew is not throwing OOM when it can't allocate memory
• ARROW-2514 - [Python] Inferring / converting nested Numpy array is very slow
• ARROW-2515 - Errors with DictionaryArray inside of ListArray or other DictionaryArray
• ARROW-2518 - [Java] Restore Java unit tests and javadoc test to CI matrix
• ARROW-2530 - [GLib] Out-of-source build is failed
• ARROW-2534 - [C++] libarrow.so leaks zlib symbols
• ARROW-2545 - [Python] Arrow fails linking against statically-compiled Python
• ARROW-2554 - pa.array type inference bug when using NS-timestamp
• ARROW-2561 - [C++] Crash in cuda-test shutdown with coverage enabled
• ARROW-2564 - [C++] Rowwise Tutorial is out of date
• ARROW-2565 - [Plasma] new subscriber cannot receive notifications about existing objects
• ARROW-2570 - [Python] Add support for writing parquet files with LZ4 compression
• ARROW-2571 - [C++] Lz4Codec doesn't properly handle empty data
• ARROW-2575 - [Python] Exclude hidden files when reading Parquet dataset
• ARROW-2578 - [Plasma] Valgrind errors related to std::random_device
• ARROW-2589 - [Python] test_parquet.py regression with Pandas 0.23.0
• ARROW-2593 - [Python] TypeError: data type "mixed-integer" not understood
• ARROW-2594 - [Java] Vector reallocation does not properly clear reused buffers
• ARROW-2601 - [Python] MemoryPool bytes_allocated causes seg
• ARROW-2603 - [Python] from pandas raises ArrowInvalid for date(time) subclasses
• ARROW-2615 - [Rust] Refactor introduced a bug around Arrays of String
• ARROW-2629 - [Plasma] Iterator invalidation for pending_notifications_
• ARROW-2630 - [Java] Typo in the document
• ARROW-2632 - [Java] ArrowStreamWriter accumulates ArrowBlock but does not use them
• ARROW-2640 - JS Writer should serialize schema metadata
• ARROW-2643 - [C++] Travis-CI build failure with cpp toolchain enabled
• ARROW-2644 - [Python] parquet binding fails building on AppVeyor
• ARROW-2655 - [C++] Failure with -Werror=conversion on gcc 7.3.0
• ARROW-2657 - Segfault when importing TensorFlow after Pyarrow
• ARROW-2668 - [C++] -Wnull-pointer-arithmetic warning with dlmalloc.c on clang 6.0, Ubuntu 14.04
• ARROW-2669 - [C++] EP_CXX_FLAGS not passed on when building gbenchmark
• ARROW-2675 - Arrow build error with clang-10 (Apple Clang / LLVM)
• ARROW-2683 - [Python] Resource Warning (Unclosed File) when using pyarrow.parquet.read_table()
• ARROW-2690 - [C++] Plasma does not follow style conventions for variable and function names
• ARROW-2691 - [Rust] Travis fails due to formatting diff
• ARROW-2693 - [Python] pa.chunked_array causes a segmentation fault on empty input
• ARROW-2694 - [Python] ArrayValue string conversion returns the representation instead of the converted python object string
• ARROW-2698 - [Python] Exception when passing a string to Table.column
• ARROW-2711 - [Python/C++] Pandas-Arrow doesn't roundtrip when column of lists has empty first element
• ARROW-2716 - [Python] Make manylinux1 base image independent of Python patch releases
• ARROW-2721 - [C++] Link error with Arrow C++ build with -DARROW_ORC=ON on CentOS 7
• ARROW-2722 - [Python] ndarray to arrow conversion fails when downcasted from pandas to_numeric
• ARROW-2723 - [C++] arrow-orc.pc is missing
• ARROW-2726 - [C++] The latest Boost version is wrong
• ARROW-2727 - [Java] Unable to build java/adapters module
• ARROW-2741 - [Python] pa.array from np.datetime[D] and type=pa.date64 produces invalid results
• ARROW-2744 - [Python] Writing to parquet crashes when writing a ListArray of empty lists
• ARROW-2745 - [C++] ORC ExternalProject needs to declare dependency on vendored protobuf
• ARROW-2747 - [CI] [Plasma] huge tables test failure on Travis
• ARROW-2754 - [Python] When installing pyarrow via pip, a debug build is created
• ARROW-2770 - [Packaging] Account for conda-forge compiler migration in conda recipes
• ARROW-2773 - [Python] Corrected parquet docs partition_cols parameter name
• ARROW-2781 - [Python] Download boost using curl in manylinux1 image
• ARROW-2787 - [Python] Memory Issue passing table from python to c++ via cython
• ARROW-2795 - [Python] Run TensorFlow import workaround only on Linux
• ARROW-2806 - [Python] Inconsistent handling of np.nan
• ARROW-2810 - [Plasma] Plasma public headers leak flatbuffers.h
• ARROW-2812 - [Ruby] StructArray#[] raises NoMethodError
• ARROW-2820 - [Python] RecordBatch.from_arrays does not validate array lengths are all equal
• ARROW-2823 - [C++] Search for flatbuffers in /lib64
• ARROW-2841 - [Go] Fix recent Go build failures in Travis CI
• ARROW-2850 - [C++/Python] PARQUET_RPATH_ORIGIN=ON missing in manylinux1 build
• ARROW-2851 - [C++] Update RAT excludes for new install file names
• ARROW-2852 - [Rust] Mark Array as Sync and Send
• ARROW-2862 - [C++] Ensure thirdparty download directory has been created in thirdparty/download_thirdparty.sh
• ARROW-2867 - [Python] Incorrect example for Cython usage
• ARROW-2871 - [Python] Array.to_numpy is invalid for boolean arrays
• ARROW-2872 - [Python] Add pytest mark to opt into TensorFlow-related unit tests
• ARROW-2876 - [Packaging] Crossbow builds can hang if you cloned using SSH
• ARROW-2877 - [Packaging] crossbow submit results in duplicate Travis CI build
• ARROW-2878 - [Packaging] README.md does not mention setting GitHub API token in user's crossbow repo settings
• ARROW-2883 - [Plasma] Compilation warnings
• ARROW-2891 - Preserve schema in write_to_dataset
• ARROW-2894 - [Glib] Format tests broken due to recent refactor
• ARROW-2901 - [Java] Build is failing on Java9
• ARROW-2902 - [Python] HDFS Docker integration tests leave around files created by root
• ARROW-2911 - [Python] Parquet binary statistics that end in '\0' truncate last byte
• ARROW-2917 - [Python] Tensor requiring gradiant cannot be serialized with pyarrow.serialize
• ARROW-2920 - [Python] Segfault with pytorch 0.4
• ARROW-2926 - [Python] ParquetWriter segfaults in example where passed schema and table schema do not match
• ARROW-2930 - [C++] Trying to set target properties on not existing CMake target
• ARROW-2940 - [Python] Import error with pytorch 0.3
• ARROW-2945 - [Packaging] Update argument check for 02-source.sh
• ARROW-2955 - [Python] Typo in pyarrow's HDFS API result
• ARROW-2963 - [Python] Deadlock during fork-join and use_threads=True
• ARROW-2978 - [Rust] Travis CI build is failing
• ARROW-2982 - The "--show-progress" option is only supported in wget 1.16 and higher
• ARROW-640 - [Python] Arrow scalar values should have a sensible __hash__ and comparison

Improvement

• ARROW-1454 - [Python] More informative error message when attempting to write an unsupported Arrow type to Parquet format
• ARROW-1722 - [C++] Add linting script to look for C++/CLI issues
• ARROW-1731 - [Python] Provide for selecting a subset of columns to convert in RecordBatch/Table.from_pandas
• ARROW-1744 - [Plasma] Provide TensorFlow operator to read tensors from plasma
• ARROW-1858 - [Python] Add documentation about parquet.write_to_dataset and related methods
• ARROW-1886 - [Python] Add function to "flatten" structs within tables
• ARROW-1928 - [C++] Add benchmarks comparing performance of internal::BitmapReader/Writer with naive approaches
• ARROW-1954 - [Python] Add metadata accessor to pyarrow.Field
• ARROW-2014 - [Python] Document read_pandas method in pyarrow.parquet
• ARROW-2060 - [Python] Documentation for creating StructArray using from_arrays or a sequence of dicts
• ARROW-2061 - [C++] Run ASAN builds in Travis CI
• ARROW-2074 - [Python] Allow type inference for struct arrays
• ARROW-2097 - [Python] Suppress valgrind stdout/stderr in Travis CI builds when there are no errors
• ARROW-2100 - [Python] Drop Python 3.4 support
• ARROW-2140 - [Python] Conversion from Numpy float16 array unimplemented
• ARROW-2141 - [Python] Conversion from Numpy object array to varsize binary unimplemented
• ARROW-2147 - [Python] Type inference doesn't work on lists of Numpy arrays
• ARROW-2222 - [C++] Add option to validate Flatbuffers messages
• ARROW-2224 - [C++] Get rid of boost regex usage
• ARROW-2241 - [Python] Simple script for running all current ASV benchmarks at a commit or tag
• ARROW-2264 - [Python] Efficiently serialize numpy arrays with dtype of unicode fixed length string
• ARROW-2276 - [Python] Tensor could implement the buffer protocol
• ARROW-2281 - [Python] Expose MakeArray to construct arrays from buffers
• ARROW-2285 - [Python] Can't convert Numpy string arrays
• ARROW-2287 - [Python] chunked array not iterable, not indexable
• ARROW-2301 - [Python] Add source distribution publishing instructions to package / release management documentation
• ARROW-2302 - [GLib] Run autotools and meson Linux builds in same Travis CI build entry
• ARROW-2308 - Serialized tensor data should be 64-byte aligned.
• ARROW-2315 - [C++/Python] Add method to flatten a struct array
• ARROW-2322 - Document requirements to run dev/release/01-perform.sh
• ARROW-2325 - [Python] Update setup.py to use Markdown project description
• ARROW-2332 - [Python] Provide API for reading multiple Feather files
• ARROW-2335 - [Go] Move Go README one directory higher
• ARROW-2340 - [Website] Add blog post about Go codebase donation
• ARROW-2341 - [Python] pa.union() mode argument unintuitive
• ARROW-2348 - [GLib] Remove Go example
• ARROW-2350 - Shrink size of spark_integration Docker container
• ARROW-2376 - [Rust] Travis should run tests for Rust library
• ARROW-2378 - [Rust] Use rustfmt to format source code
• ARROW-2384 - Rust: Use Traits rather than defining methods directly
• ARROW-2388 - [C++] Arrow::StringBuilder::Append() uses null_bytes not valid_bytes
• ARROW-2395 - [Python] Correct flake8 errors outside of pyarrow/ directory
• ARROW-2396 - Unify Rust Errors
• ARROW-2397 - Document changes in Tensor encoding in IPC.md.
• ARROW-2400 - [C++] Status destructor is expensive
• ARROW-2402 - [C++] FixedSizeBinaryBuilder::Append lacks "const char*" overload
• ARROW-2404 - Fix declaration of 'type_id' hides class member warning in msvc build
• ARROW-2411 - [C++] Add method to append batches of null-terminated strings to StringBuilder
• ARROW-2413 - [Rust] Remove useless use of `format!`
• ARROW-2414 - [Documentation] Fix miscellaneous documentation typos
• ARROW-2415 - [Rust] Fix using references in pattern matching
• ARROW-2417 - [Rust] Review APIs for safety
• ARROW-2422 - [Python] Support more filter operators on Hive partitioned Parquet files
• ARROW-2427 - [C++] ReadAt implementations suboptimal
• ARROW-2430 - MVP for branch based packaging automation
• ARROW-2433 - [Rust] Add Builder.push_slice(&[T])
• ARROW-2434 - [Rust] Add windows support
• ARROW-2435 - [Rust] Add memory pool abstraction.
• ARROW-2436 - [Rust] Add windows CI
• ARROW-2442 - [C++] Disambiguate Builder::Append overloads
• ARROW-2445 - [Rust] Add documentation and make some fields private
• ARROW-2448 - Segfault when plasma client goes out of scope before buffer.
• ARROW-2451 - Handle more dtypes efficiently in custom numpy array serializer.
• ARROW-2453 - [Python] Improve Table column access
• ARROW-2458 - [Plasma] PlasmaClient uses global variable
• ARROW-2463 - [C++] Update flatbuffers to 1.9.0
• ARROW-2469 - Make out arguments last in ReadMessage API.
• ARROW-2470 - [C++] FileGetSize() should not seek
• ARROW-2472 - [Rust] The Schema and Fields types should not have public attributes
• ARROW-2478 - [C++] Introduce a checked_cast function that performs a dynamic_cast in debug mode
• ARROW-2480 - [C++] Enable casting the value of a decimal to int32_t or int64_t
• ARROW-2481 - [Rust] Move calls to free() into memory.rs
• ARROW-2484 - [C++] Document ABI compliance checking
• ARROW-2485 - [C++] Output diff when run_clang_format.py reports a change
• ARROW-2486 - [C++/Python] Provide a Docker image that contains all dependencies for development
• ARROW-2488 - [C++] List Boost 1.67 as supported version
• ARROW-2506 - [Plasma] Build error on macOS
• ARROW-2507 - [Rust] Don't take a reference when not needed
• ARROW-2508 - [Python] pytest API changes make tests fail
• ARROW-2513 - [Python] DictionaryType should give access to index type and dictionary array
• ARROW-2516 - AppVeyor Build Matrix should be specific to the changes made in a PR
• ARROW-2521 - [Rust] Refactor Rust API to use traits and generics
• ARROW-2522 - [C++] Version shared library files
• ARROW-2525 - [GLib] Add garrow_struct_array_flatten()
• ARROW-2526 - [GLib] Update .gitignore
• ARROW-2527 - [GLib] Enable GPU document
• ARROW-2529 - [C++] Update mention of clang-format to 5.0 in the docs
• ARROW-2531 - [C++] Update clang bits to 6.0
• ARROW-2533 - [CI] Fast finish failing AppVeyor builds
• ARROW-2536 - [Rust] ListBuilder uses wrong initial size for offset builder
• ARROW-2539 - [Plasma] Use unique_ptr instead of raw pointer
• ARROW-2540 - [Plasma] add constructor/destructor to make sure dlfree is called automatically
• ARROW-2541 - [Plasma] Clean up macro usage
• ARROW-2544 - [CI] Run C++ tests with two jobs on Travis-CI
• ARROW-2547 - [Format] Fix off-by-one in List<List> example
• ARROW-2548 - [Format] Clarify `List` Array example
• ARROW-2549 - [GLib] Apply arrow::StatusCodes changes to GArrowError
• ARROW-2550 - [C++] Add missing status codes into arrow::StatusCode::CodeAsString()
• ARROW-2551 - [Plasma] Improve notification logic
• ARROW-2553 - [Python] Set MACOSX_DEPLOYMENT_TARGET in wheel build
• ARROW-2558 - [Plasma] avoid walk through all the objects when a client disconnects
• ARROW-2563 - [Rust] Poor caching in Travis-CI
• ARROW-2567 - [C++/Python] Unit is ignored on comparison of TimestampArrays
• ARROW-2568 - [Python] Expose thread pool size setting to Python, and deprecate "nthreads"
• ARROW-2569 - [C++] Improve thread pool size heuristic
• ARROW-2574 - [CI] Collect and publish Python coverage
• ARROW-2577 - [Plasma] Add ASV benchmarks
• ARROW-2580 - [GLib] Fix abs functions for Decimal128
• ARROW-2582 - [GLib] Add negate functions for Decimal128
• ARROW-2585 - [C++] Add Decimal128::FromBigEndian
• ARROW-2586 - [C++] Make child builders of ListBuilder and StructBuilder shared_ptr's
• ARROW-2595 - [Plasma] operator[] creates entries in map
• ARROW-2596 - [GLib] Use the default value of GTK-Doc
• ARROW-2597 - [Plasma] remove UniqueIDHasher
• ARROW-2611 - [Python] Python 2 integer serialization
• ARROW-2612 - [Plasma] Fix deprecated PLASMA_DEFAULT_RELEASE_DELAY
• ARROW-2626 - [Python] pandas ArrowInvalid message should include failing column name
• ARROW-2634 - [Go] Add LICENSE additions for Go subproject
• ARROW-2635 - [Ruby] LICENSE.txt isn't suitable
• ARROW-2636 - [Ruby] "Unofficial" package note is missing
• ARROW-2638 - [Python] Prevent calling extension class constructors directly
• ARROW-2639 - [Python] Remove unnecessary _check_nullptr methods
• ARROW-2641 - [C++] Investigate spurious memset() calls
• ARROW-2645 - [Java] ArrowStreamWriter accumulates DictionaryBatch ArrowBlocks
• ARROW-2649 - [C++] Add std::generate()-like function for faster bitmap writing
• ARROW-2656 - [Python] Improve ParquetManifest creation time
• ARROW-2662 - [Python] Add to_pandas / to_numpy to ChunkedArray
• ARROW-2663 - [Python] Make dictionary_encode and unique accesible on Column / ChunkedArray
• ARROW-2664 - [Python] Implement __getitem__ / slicing on Buffer
• ARROW-2666 - [Python] numpy.asarray should trigger to_pandas on Array/ChunkedArray
• ARROW-2672 - [Python] Build ORC extension in manylinux1 wheels
• ARROW-2674 - [Packaging] Start building nightlies
• ARROW-2676 - [Packaging] Deploy build artifacts to github releases
• ARROW-2677 - [Python] Expose Parquet ZSTD compression
• ARROW-2678 - [GLib] Add extra information to common build problems on macOS
• ARROW-2680 - [Python] Add documentation about type inference in Table.from_pandas
• ARROW-2682 - [CI] Notify in Slack about broken builds
• ARROW-2689 - [Python] Remove references to timestamps_to_ms argument from documentation
• ARROW-2692 - [Python] Add test for writing dictionary encoded columns to chunked Parquet files
• ARROW-2695 - [Python] Prevent calling scalar contructors directly
• ARROW-2696 - [JAVA] enhance AllocationListener with an onFailedAllocation() call
• ARROW-2700 - [Python] Add simple examples to Array.cast docstring
• ARROW-2704 - [Java] IPC stream handling should be more friendly to low level processing
• ARROW-2713 - [Packaging] Fix linux package builds
• ARROW-2724 - [Packaging] Determine whether all the expected artifacts are uploaded
• ARROW-2725 - [JAVA] make Accountant.AllocationOutcome publicly visible
• ARROW-2731 - Allow usage of external ORC library
• ARROW-2732 - Update brew packages for macOS
• ARROW-2733 - [GLib] Cast garrow_decimal128 to gint64
• ARROW-2738 - [GLib] Use Brewfile on installation process
• ARROW-2739 - [GLib] Use G_DECLARE_DERIVABLE_TYPE for GArrowDecimalDataType and GArrowDecimal128ArrayBuilder
• ARROW-2740 - [Python] Add address property to Buffer
• ARROW-2742 - [Python] Allow Table.from_batches to use Iterator of ArrowRecordBatches
• ARROW-2748 - [GLib] Add garrow_decimal_data_type_get_scale() (and _precision())
• ARROW-2749 - [GLib] Rename *garrow_decimal128_array_get_value to *garrow_decimal128_array_format_value
• ARROW-2752 - [GLib] Document garrow_decimal_data_type_new()
• ARROW-2755 - [Python] Allow using Ninja to build extension
• ARROW-2756 - [Python] Remove redundant imports and minor fixes in parquet tests
• ARROW-2758 - [Plasma] Use Scope enum in Plasma
• ARROW-2760 - [Python] Remove legacy property definition syntax from parquet module and test them
• ARROW-2761 - Support set filter operators on Hive partitioned Parquet files
• ARROW-2763 - [Python] Make parquet _metadata file accessible from ParquetDataset
• ARROW-2780 - [Go] Run code coverage analysis
• ARROW-2794 - [Plasma] Add Delete method for multiple objects
• ARROW-2798 - [Plasma] Use hashing function that takes into account all UniqueID bytes
• ARROW-2802 - [Docs] Move release management guide to project wiki
• ARROW-2804 - [Website] Link to Developer wiki (Confluence) from front page
• ARROW-2805 - [Python] TensorFlow import workaround not working with tensorflow-gpu if CUDA is not installed
• ARROW-2809 - [C++] Decrease verbosity of lint checks in Travis CI
• ARROW-2811 - [Python] Test serialization for determinism
• ARROW-2815 - [CI] Suppress DEBUG logging when building Java library in C++ CI entries
• ARROW-2816 - [Python] Add __iter__ method to NativeFile
• ARROW-2821 - [C++] Only zero memory in BooleanBuilder in one place
• ARROW-2822 - [C++] Zero padding bytes in PoolBuffer::Resize
• ARROW-2827 - [C++] LZ4 and Zstd build may be failed in parallel build
• ARROW-2829 - [GLib] Add GArrowORCFileReader
• ARROW-2830 - [Packaging] Enable parallel build for deb package build again
• ARROW-2833 - [Python] Column.__repr__ will lock up Jupyter with large datasets
• ARROW-2834 - [GLib] Remove "enable_" prefix from Meson options
• ARROW-2838 - [Python] Speed up null testing with Pandas semantics
• ARROW-2844 - [Packaging] Test OSX wheels after build
• ARROW-2847 - [Packaging] Fix artifact name matching for conda forge packages
• ARROW-2848 - [Packaging] lib*.deb package name doesn't match so version
• ARROW-2849 - [Ruby] Arrow::Table#load supports ORC
• ARROW-2859 - [Python] Handle objects exporting the buffer protocol in open_stream, open_file, and RecordBatch*Reader APIs
• ARROW-2861 - [Python] Add extra tips about using Parquet to store index-less pandas data
• ARROW-2864 - [Plasma] Add deletion cache to delete objects later
• ARROW-2869 - [Python] Add documentation for Array.to_numpy
• ARROW-2886 - [Release] An unused variable exists
• ARROW-2890 - [Plasma] Make Python PlasmaClient.release private
• ARROW-2893 - [C++] Remove PoolBuffer class from public API and hide implementation details behind factory functions
• ARROW-2897 - Organize supported Ubuntu versions
• ARROW-2906 - [Website] Remove the link to slack channel
• ARROW-2907 - [GitHub] Improve "How to contribute patches"
• ARROW-2914 - [Integration] Add WindowPandasUDFTests to Spark Integration
• ARROW-2918 - [C++] Improve formatting of Struct pretty prints
• ARROW-2921 - [Release] Update .deb/.rpm changelos in preparation
• ARROW-2922 - [Release] Make python command name customizable
• ARROW-2923 - [Doc] Add instructions for running Spark integration tests
• ARROW-2937 - [Java] Follow-up changes to ARROW-2704
• ARROW-2943 - [C++] Implement BufferedOutputStream::Flush
• ARROW-2946 - [Packaging] Stop to use PWD in debian/rules
• ARROW-2947 - [Packaging] Remove Ubuntu Artful
• ARROW-2949 - [CI] repo.continuum.io can be flaky in builds
• ARROW-2951 - [CI] Changes in format/ should cause Appveyor builds to run
• ARROW-2953 - [Plasma] Store memory usage
• ARROW-2954 - [Plasma] Store object_id only once in object table
• ARROW-2985 - [Ruby] Run unit tests in verify-release-candidate.sh
• ARROW-2988 - [Release] More automated release verification on Windows
• ARROW-2990 - [GLib] Fail to build with rpath-ed Arrow C++ on macOS
• ARROW-889 - [C++] Implement arrow::PrettyPrint for ChunkedArray
• ARROW-906 - [C++] Serialize Field metadata to IPC metadata

New Feature

• ARROW-1018 - [C++] Add option to create FileOutputStream, ReadableFile from OS file descriptor
• ARROW-1163 - [Plasma][Java] Java client for Plasma
• ARROW-1388 - [Python] Add Table.drop method for removing columns
• ARROW-1715 - [Python] Implement pickling for Column, ChunkedArray, RecordBatch, Table
• ARROW-1780 - [Java] JDBC Adapter for Apache Arrow
• ARROW-1964 - [Python] Expose Builder classes
• ARROW-2207 - [GLib] Support decimal type
• ARROW-2267 - Rust bindings
• ARROW-2299 - [Go] Go language implementation
• ARROW-2319 - [C++] Add buffered output class implementing OutputStream interface
• ARROW-2330 - [C++] Optimize delta buffer creation with partially finishable array builders
• ARROW-2344 - [Go] Run Go unit tests in Travis CI
• ARROW-2361 - [Rust] Start native Rust Implementation
• ARROW-2381 - [Rust] Buffer should have an Iterator
• ARROW-2385 - [Rust] Implement to_json() for Field and DataType
• ARROW-2398 - [Rust] Provide a zero-copy builder for type-safe Buffer
• ARROW-2401 - Support filters on Hive partitioned Parquet files
• ARROW-2407 - [GLib] Add garrow_string_array_builder_append_values()
• ARROW-2408 - [Rust] It should be possible to get a &mut[T] from Builder
• ARROW-2440 - [Rust] Implement ListBuilder
• ARROW-2482 - [Rust] support nested types
• ARROW-2493 - [Python] Add support for pickling to buffers and arrays
• ARROW-2537 - [Ruby] Import
• ARROW-2576 - [GLib] Add abs functions for Decimal128.
• ARROW-2604 - [Java] Add method overload for VarCharVector.set(int,String)
• ARROW-2608 - [Java/Python] Add pyarrow.{Array,Field}.from_jvm / jvm_buffer
• ARROW-2613 - [Docs] Update the gen_apidocs docker script
• ARROW-2661 - [Python/C++] Allow passing HDFS Config values via map/dict instead of needing an hdfs-site.xml file
• ARROW-2699 - [C++/Python] Add Table method that replaces a column with a new supplied column
• ARROW-2701 - [C++] Make MemoryMappedFile resizable
• ARROW-2729 - [GLib] Add decimal128 array builder
• ARROW-2751 - [GLib] Add garrow_table_replace_column()
• ARROW-2753 - [GLib] Add garrow_schema_*_field()
• ARROW-2784 - [C++] MemoryMappedFile::WriteAt allow writing past the end
• ARROW-2790 - [C++] Buffers contain uninitialized memory
• ARROW-2824 - [GLib] Add garrow_decimal128_array_get_value()
• ARROW-2881 - [Website] Add Community tab to website
• ARROW-530 - C++/Python: Provide subpools for better memory allocation tracking
• ARROW-564 - [Python] Add methods to return vanilla NumPy arrays (plus boolean mask array if there are nulls)

Sub-task

• ARROW-1868 - [Java] Change vector getMinorType to use MinorType instead of Types.MinorType
• ARROW-1913 - [Java] Fix Javadoc generation bugs with JDK8
• ARROW-2416 - [C++] Support system libprotobuf
• ARROW-2494 - Return status codes from PlasmaClient::Seal
• ARROW-2498 - [Java] Upgrade to JDK 1.8
• ARROW-2717 - [Packaging] Postfix conda artifacts with target arch
• ARROW-2718 - [Packaging] GPG sign downloaded artifacts

Task

• ARROW-2055 - [Java] Upgrade to Java 8
• ARROW-2334 - [C++] Update boost to 1.66.0
• ARROW-2343 - [Java/Packaging] Run mvn clean in API doc builds
• ARROW-2345 - [Documentation] Fix bundle exec and set sphinx nosidebar to True
• ARROW-2353 - Test correctness of built wheel on AppVeyor
• ARROW-2464 - [Python] Use a python_version marker instead of a condition
• ARROW-2477 - [Rust] Set up code coverage in CI
• ARROW-2543 - [Rust] CI should cache dependencies for faster builds
• ARROW-2562 - [C++] Upload coverage data to codecov.io
• ARROW-2566 - [CI] Add codecov.io badge to README
• ARROW-2614 - [CI] Remove 'group: deprecated' in Travis
• ARROW-2791 - [Packaging] Build Ubuntu 18.04 packages
• ARROW-2792 - [Packaging] Consider uploading tarballs to avoid naming conflicts
• ARROW-2836 - [Packaging] Expand build matrices to multiple tasks
• ARROW-2837 - [C++] ArrayBuilder::null_bitmap returns PoolBuffer
• ARROW-2845 - [Packaging] Upload additional debian artifacts
• ARROW-2846 - [Packaging] Update nightly build in crossbow as well as the sample configuration
• ARROW-2855 - [C++] Blog post that outlines the benefits of using jemalloc
• ARROW-2868 - [Packaging] Fix centos-7 build
• ARROW-2875 - [Packaging] Don't attempt to download arrow archive in linux builds
• ARROW-2884 - [Packaging] Options to build packages from apache source archive
• ARROW-2898 - [Packaging] Setuptools_scm just shipped a new version which fails to parse `apache-arrow-` tag
• ARROW-2908 - [Rust] Update version to 0.10.0
• ARROW-2915 - [Packaging] Remove artifact form ubuntu-trusty build
• ARROW-2924 - [Java] mvn release fails when an older maven javadoc plugin is installed
• ARROW-2927 - [Packaging] AppVeyor wheel task is failing on initial checkout
• ARROW-2928 - [Packaging] AppVeyor crossbow conda builds are picking up boost 1.63.0 instead of the installed version
• ARROW-2929 - [C++] ARROW-2826 Breaks parquet-cpp 1.4.0 builds
• ARROW-2934 - [Packaging] Add checksums creation to sign subcommand
• ARROW-2935 - [Packaging] Add verify_binary_artifacts function to verify-release-candidate.sh
• ARROW-2944 - [Format] Arrow columnar format docs mentions VectorLayout that does not exist anymore
• ARROW-2962 - [Packaging] Bintray descriptor files are no longer needed
• ARROW-2977 - [Packaging] Release verification script should check rust too

Test

• ARROW-2557 - [Rust] Add badge for code coverage in README
• ARROW-2895 - [Ruby] CI isn't ran when C++ is changed
• ARROW-2896 - [GLib] export are missing

Wish

• ARROW-2286 - [Python] Allow subscripting pyarrow.lib.StructValue
• ARROW-2364 - [Plasma] PlasmaClient::Get() could take vector of object ids
• ARROW-2389 - [C++] Add StatusCode::OverflowError
• ARROW-2390 - [C++/Python] CheckPyError() could inspect exception type
• ARROW-2479 - [C++] Have a global thread pool
• ARROW-2499 - [C++] Add iterator facility for Python sequences
• ARROW-2505 - [C++] Disable MSVC warning C4800
• ARROW-2660 - [Python] Experiment with zero-copy pickling
• ARROW-2825 - [C++] Need AllocateBuffer / AllocateResizableBuffer variant with default memory pool
• ARROW-2826 - [C++] Clarification needed between ArrayBuilder::Init(), Resize() and Reserve()
• ARROW-902 - [C++] Build C++ project including thirdparty dependencies from local tarballs

Apache Arrow 0.9.0 (16 March 2018)

Bug

• ARROW-1345 - [Python] Conversion from nested NumPy arrays fails on integers other than int64, float32
• ARROW-1646 - [Python] pyarrow.array cannot handle NumPy scalar types
• ARROW-1856 - [Python] Auto-detect Parquet ABI version when using PARQUET_HOME
• ARROW-1909 - [C++] Bug: Build fails on windows with "-DARROW_BUILD_BENCHMARKS=ON"
• ARROW-1912 - [Website] Add org affiliations to committers.html
• ARROW-1919 - Plasma hanging if object id is not 20 bytes
• ARROW-1924 - [Python] Bring back pickle=True option for serialization
• ARROW-1933 - [GLib] Build failure with --with-arrow-cpp-build-dir and GPU enabled Arrow C++
• ARROW-1940 - [Python] Extra metadata gets added after multiple conversions between pd.DataFrame and pa.Table
• ARROW-1941 - Table <–> DataFrame roundtrip failing
• ARROW-1943 - Handle setInitialCapacity() for deeply nested lists of lists
• ARROW-1944 - FindArrow has wrong ARROW_STATIC_LIB
• ARROW-1945 - [C++] Fix doxygen documentation of array.h
• ARROW-1946 - Add APIs to decimal vector for writing big endian data
• ARROW-1948 - [Java] ListVector does not handle ipc with all non-null values with none set
• ARROW-1950 - [Python] pandas_type in pandas metadata incorrect for List types
• ARROW-1953 - [JS] JavaScript builds broken on master
• ARROW-1958 - [Python] Error in pandas conversion for datetimetz row index
• ARROW-1961 - [Python] Writing Parquet file with flavor='spark' loses pandas schema metadata
• ARROW-1966 - [C++] Support JAVA_HOME paths in HDFS libjvm loading that include the jre directory
• ARROW-1971 - [Python] Add pandas serialization to the default
• ARROW-1972 - Deserialization of buffer objects (and pandas dataframes) segfaults on different processes.
• ARROW-1973 - [Python] Memory leak when converting Arrow tables with array columns to Pandas dataframes.
• ARROW-1976 - [Python] Handling unicode pandas columns on parquet.read_table
• ARROW-1979 - [JS] JS builds handing in es2015:umd tests
• ARROW-1980 - [Python] Race condition in write\_to\_dataset
• ARROW-1982 - [Python] Return parquet statistics min/max as values instead of strings
• ARROW-1991 - [GLib] Docker-based documentation build is broken
• ARROW-1992 - [Python] to_pandas crashes when using strings_to_categoricals on empty string cols on 0.8.0
• ARROW-1997 - [Python] to_pandas with strings_to_categorical fails
• ARROW-1998 - [Python] Table.from_pandas crashes when data frame is empty
• ARROW-1999 - [Python] from_numpy_dtype returns wrong types
• ARROW-2000 - Deduplicate file descriptors when plasma store replies to get request.
• ARROW-2002 - use pyarrow download file will raise queue.Full exceptions sometimes
• ARROW-2003 - [Python] Do not use deprecated kwarg in pandas.core.internals.make_block
• ARROW-2005 - [Python] pyflakes warnings on Cython files not failing build
• ARROW-2008 - [Python] Type inference for int32 NumPy arrays (expecting list) returns int64 and then conversion fails
• ARROW-2010 - [C++] Compiler warnings with CHECKIN warning level in ORC adapter
• ARROW-2017 - Array initialization with large (>2**31-1) uint64 values fails
• ARROW-2023 - [C++] Test opening IPC stream reader or file reader on an empty InputStream
• ARROW-2025 - [Python/C++] HDFS Client disconnect closes all open clients
• ARROW-2029 - [Python] Program crash on HdfsFile.tell if file is closed
• ARROW-2032 - [C++] ORC ep installs on each call to ninja build (even if no work to do)
• ARROW-2033 - pa.array() doesn't work with iterators
• ARROW-2039 - [Python] pyarrow.Buffer().to_pybytes() segfaults
• ARROW-2040 - [Python] Deserialized Numpy array must keep ref to underlying tensor
• ARROW-2047 - [Python] test_serialization.py uses a python executable in PATH rather than that used for a test run
• ARROW-2049 - ARROW-2049: [Python] Use python -m cython to run Cython, instead of CYTHON_EXECUTABLE
• ARROW-2062 - [C++] Stalled builds in test_serialization.py in Travis CI
• ARROW-2070 - [Python] chdir logic in setup.py buggy
• ARROW-2072 - [Python] decimal128.byte_width crashes
• ARROW-2080 - [Python] Update documentation after ARROW-2024
• ARROW-2085 - HadoopFileSystem.isdir and .isfile should return False if the path doesn't exist
• ARROW-2106 - [Python] pyarrow.array can't take a pandas Series of python datetime objects.
• ARROW-2109 - [C++] Boost 1.66 compilation fails on Windows on linkage stage
• ARROW-2124 - [Python] ArrowInvalid raised if the first item of a nested list of numpy arrays is empty
• ARROW-2128 - [Python] Cannot serialize array of empty lists
• ARROW-2129 - [Python] Segmentation fault on conversion of empty array to Pandas
• ARROW-2131 - [Python] Serialization test fails on Windows when library has been built in place / not installed
• ARROW-2133 - [Python] Segmentation fault on conversion of empty nested arrays to Pandas
• ARROW-2135 - [Python] NaN values silently casted to int64 when passing explicit schema for conversion in Table.from_pandas
• ARROW-2145 - [Python] Decimal conversion not working for NaN values
• ARROW-2150 - [Python] array equality defaults to identity
• ARROW-2151 - [Python] Error when converting from list of uint64 arrays
• ARROW-2153 - [C++/Python] Decimal conversion not working for exponential notation
• ARROW-2157 - [Python] Decimal arrays cannot be constructed from Python lists
• ARROW-2160 - [C++/Python] Fix decimal precision inference
• ARROW-2161 - [Python] Skip test_cython_api if ARROW_HOME isn't defined
• ARROW-2162 - [Python/C++] Decimal Values with too-high precision are multiplied by 100
• ARROW-2167 - [C++] Building Orc extensions fails with the default BUILD_WARNING_LEVEL=Production
• ARROW-2170 - [Python] construct_metadata fails on reading files where no index was preserved
• ARROW-2171 - [Python] OwnedRef is fragile
• ARROW-2172 - [Python] Incorrect conversion from Numpy array when stride % itemsize != 0
• ARROW-2173 - [Python] NumPyBuffer destructor should hold the GIL
• ARROW-2175 - [Python] arrow_ep build is triggering during parquet-cpp build in Travis CI
• ARROW-2178 - [JS] Fix JS html FileReader example
• ARROW-2179 - [C++] arrow/util/io-util.h missing from libarrow-dev
• ARROW-2192 - Commits to master should run all builds in CI matrix
• ARROW-2209 - [Python] Partition columns are not correctly loaded in schema of ParquetDataset
• ARROW-2210 - [C++] TestBuffer_ResizeOOM has a memory leak with jemalloc
• ARROW-2212 - [C++/Python] Build Protobuf in base manylinux 1 docker image
• ARROW-2223 - [JS] installing umd release throws an error
• ARROW-2227 - [Python] Table.from_pandas does not create chunked_arrays.
• ARROW-2230 - [Python] JS version number is sometimes picked up
• ARROW-2232 - [Python] pyarrow.Tensor constructor segfaults
• ARROW-2234 - [JS] Read timestamp low bits as Uint32s
• ARROW-2240 - [Python] Array initialization with leading numpy nan fails with exception
• ARROW-2244 - [C++] Slicing NullArray should not cause the null count on the internal data to be unknown
• ARROW-2245 - [Python] Revert static linkage of parquet-cpp in manylinux1 wheel
• ARROW-2246 - [Python] Use namespaced boost in manylinux1 package
• ARROW-2251 - [GLib] Destroying GArrowBuffer while GArrowTensor that uses the buffer causes a crash
• ARROW-2254 - [Python] Local in-place dev versions picking up JS tags
• ARROW-2258 - [C++] Appveyor builds failing on master
• ARROW-2263 - [Python] test_cython.py fails if pyarrow is not in import path (e.g. with inplace builds)
• ARROW-2265 - [Python] Serializing subclasses of np.ndarray returns a np.ndarray.
• ARROW-2268 - Remove MD5 checksums from release process
• ARROW-2269 - [Python] Cannot build bdist_wheel for Python
• ARROW-2270 - [Python] ForeignBuffer doesn't tie Python object lifetime to C++ buffer lifetime
• ARROW-2272 - [Python] test_plasma spams /tmp
• ARROW-2275 - [C++] Buffer::mutable_data_ member uninitialized
• ARROW-2280 - [Python] pyarrow.Array.buffers should also include the offsets
• ARROW-2284 - [Python] test_plasma error on plasma_store error
• ARROW-2288 - [Python] slicing logic defective
• ARROW-2297 - [JS] babel-jest is not listed as a dev dependency
• ARROW-2304 - [C++] MultipleClients test in io-hdfs-test fails on trunk
• ARROW-2306 - [Python] HDFS test failures
• ARROW-2307 - [Python] Unable to read arrow stream containing 0 record batches
• ARROW-2311 - [Python] Struct array slicing defective
• ARROW-2312 - [JS] verify-release-candidate-sh must be updated to include JS in integration tests
• ARROW-2313 - [GLib] Release builds must define NDEBUG
• ARROW-2316 - [C++] Revert Buffer::mutable_data member to always inline
• ARROW-2318 - [C++] TestPlasmaStore.MultipleClientTest is flaky (hangs) in release builds
• ARROW-2320 - [C++] Vendored Boost build does not build regex library

Improvement

• ARROW-1021 - [Python] Add documentation about using pyarrow from other Cython and C++ projects
• ARROW-1035 - [Python] Add ASV benchmarks for streaming columnar deserialization
• ARROW-1463 - [JAVA] Restructure ValueVector hierarchy to minimize compile-time generated code
• ARROW-1579 - [Java] Add dockerized test setup to validate Spark integration
• ARROW-1580 - [Python] Instructions for setting up nightly builds on Linux
• ARROW-1623 - [C++] Add convenience method to construct Buffer from a string that owns its memory
• ARROW-1632 - [Python] Permit categorical conversions in Table.to_pandas on a per-column basis
• ARROW-1643 - [Python] Accept hdfs:// prefixes in parquet.read_table and attempt to connect to HDFS
• ARROW-1706 - [Python] StructArray.from_arrays should handle sequences that are coercible to arrays
• ARROW-1712 - [C++] Add method to BinaryBuilder to reserve space for value data
• ARROW-1835 - [C++] Create Arrow schema from std::tuple types
• ARROW-1861 - [Python] Fix up ASV setup, add developer instructions for writing new benchmarks and running benchmark suite locally
• ARROW-1872 - [Website] Populate hard-coded fields for current release from a YAML file
• ARROW-1927 - [Plasma] Implement delete function
• ARROW-1929 - [C++] Move various Arrow testing utility code from Parquet to Arrow codebase
• ARROW-1937 - [Python] Add documentation for different forms of constructing nested arrays from Python data structures
• ARROW-1942 - [C++] Hash table specializations for small integers
• ARROW-1947 - [Plasma] Change Client Create and Get to use Buffers
• ARROW-1951 - Add memcopy_threads to serialization context
• ARROW-1962 - [Java] Add reset() to ValueVector interface
• ARROW-1969 - [C++] Do not build ORC adapter by default
• ARROW-1977 - [C++] Update windows dev docs
• ARROW-1978 - [Website] Add more visible link to "Powered By" page to front page, simplify Powered By
• ARROW-2004 - [C++] Add shrink_to_fit option in BufferBuilder::Resize
• ARROW-2007 - [Python] Sequence converter for float32 not implemented
• ARROW-2011 - Allow setting the pickler to use in pyarrow serialization.
• ARROW-2012 - [GLib] Support "make distclean"
• ARROW-2018 - [C++] Build instruction on macOS and Homebrew is incomplete
• ARROW-2019 - Control the memory allocated for inner vector in LIST
• ARROW-2024 - [Python] Remove global SerializationContext variables
• ARROW-2028 - [Python] extra_cmake_args needs to be passed through shlex.split
• ARROW-2031 - HadoopFileSystem isn't pickleable
• ARROW-2035 - [C++] Update vendored cpplint.py to a Py3-compatible one
• ARROW-2036 - NativeFile should support standard IOBase methods
• ARROW-2042 - [Plasma] Revert API change of plasma::Create to output a MutableBuffer
• ARROW-2043 - [C++] Change description from OS X to macOS
• ARROW-2046 - [Python] Add support for PEP519 - pathlib and similar objects
• ARROW-2048 - [Python/C++] Upate Thrift pin to 0.11
• ARROW-2050 - Support setup.py pytest to automatically fetch the test dependencies
• ARROW-2064 - [GLib] Add common build problems link to the install section
• ARROW-2065 - Fix bug in SerializationContext.clone().
• ARROW-2068 - [Python] Expose Array's buffers to Python users
• ARROW-2069 - [Python] Document that Plasma is not (yet) supported on Windows
• ARROW-2071 - [Python] Reduce runtime of builds in Travis CI
• ARROW-2073 - [Python] Create StructArray from sequence of tuples given a known data type
• ARROW-2076 - [Python] Display slowest test durations
• ARROW-2083 - Support skipping builds
• ARROW-2084 - [C++] Support newer Brotli static library names
• ARROW-2086 - [Python] Shrink size of arrow_manylinux1_x86_64_base docker image
• ARROW-2087 - [Python] Binaries of 3rdparty are not stripped in manylinux1 base image
• ARROW-2088 - [GLib] Add GArrowNumericArray
• ARROW-2089 - [GLib] Rename to GARROW_TYPE_BOOLEAN for consistency
• ARROW-2090 - [Python] Add context manager methods to ParquetWriter
• ARROW-2093 - [Python] Possibly do not test pytorch serialization in Travis CI
• ARROW-2094 - [Python] Use toolchain libraries and PROTOBUF_HOME for protocol buffers
• ARROW-2095 - [C++] Suppress ORC EP build logging by default
• ARROW-2096 - [C++] Turn off Boost_DEBUG to trim build output
• ARROW-2099 - [Python] Support DictionaryArray::FromArrays in Python bindings
• ARROW-2107 - [GLib] Follow arrow::gpu::CudaIpcMemHandle API change
• ARROW-2110 - [Python] Only require pytest-runner on test commands
• ARROW-2111 - [C++] Linting could be faster
• ARROW-2117 - [C++] Pin clang to version 5.0
• ARROW-2118 - [Python] Improve error message when calling parquet.read_table on an empty file
• ARROW-2120 - Add possibility to use empty _MSVC_STATIC_LIB_SUFFIX for Thirdparties
• ARROW-2121 - [Python] Consider special casing object arrays in pandas serializers.
• ARROW-2132 - [Doc] Add links / mentions of Plasma store to main README
• ARROW-2137 - [Python] Don't print paths that are ignored when reading Parquet files
• ARROW-2138 - [C++] Have FatalLog abort instead of exiting
• ARROW-2142 - [Python] Conversion from Numpy struct array unimplemented
• ARROW-2143 - [Python] Provide a manylinux1 wheel for cp27m
• ARROW-2146 - [GLib] Implement Slice for ChunkedArray
• ARROW-2154 - [Python] __eq__ unimplemented on Buffer
• ARROW-2155 - [Python] pa.frombuffer(bytearray) returns immutable Buffer
• ARROW-2163 - Install apt dependencies separate from built-in Travis commands, retry on flakiness
• ARROW-2168 - [C++] Build toolchain builds with jemalloc
• ARROW-2169 - [C++] MSVC is complaining about uncaptured variables
• ARROW-2174 - [JS] Export format and schema enums
• ARROW-2177 - [C++] Remove support for specifying negative scale values in DecimalType
• ARROW-2180 - [C++] Remove APIs deprecated in 0.8.0 release
• ARROW-2181 - [Python] Add concat_tables to API reference, add documentation on use
• ARROW-2184 - [C++] Add static constructor for FileOutputStream returning shared_ptr to base OutputStream
• ARROW-2185 - Remove CI directives from squashed commit messages
• ARROW-2191 - [C++] Only use specific version of jemalloc
• ARROW-2198 - [Python] Docstring for parquet.read_table is misleading or incorrect
• ARROW-2199 - [JAVA] Follow up fixes for ARROW-2019. Ensure density driven capacity is never less than 1 and propagate density throughout the vector tree
• ARROW-2203 - [C++] StderrStream class
• ARROW-2204 - [C++] Build fails with TLS error on parquet-cpp clone
• ARROW-2206 - [JS] Add Perspective as a community project
• ARROW-2218 - [Python] PythonFile should infer mode when not given
• ARROW-2231 - [CI] Use clcache on AppVeyor
• ARROW-2238 - [C++] Detect clcache in cmake configuration
• ARROW-2250 - plasma_store process should cleanup on INT and TERM signals
• ARROW-2261 - [GLib] Can't share the same memory in GArrowBuffer safely
• ARROW-2279 - [Python] Better error message if lib cannot be found
• ARROW-2282 - [Python] Create StringArray from buffers
• ARROW-2283 - [C++] Support Arrow C++ installed in /usr detection by pkg-config
• ARROW-2289 - [GLib] Add Numeric, Integer and FloatingPoint data types
• ARROW-2291 - [C++] README missing instructions for libboost-regex-dev
• ARROW-2292 - [Python] More consistent / intuitive name for pyarrow.frombuffer
• ARROW-2321 - [C++] Release verification script fails with if CMAKE_INSTALL_LIBDIR is not $ARROW_HOME/lib
• ARROW-764 - [C++] Improve performance of CopyBitmap, add benchmarks

New Feature

• ARROW-1394 - [Plasma] Add optional extension for allocating memory on GPUs
• ARROW-1705 - [Python] Create StructArray from sequence of dicts given a known data type
• ARROW-1757 - [C++] Add DictionaryArray::FromArrays alternate ctor that can check or sanitized "untrusted" indices
• ARROW-1832 - [JS] Implement JSON reader for integration tests
• ARROW-1920 - Add support for reading ORC files
• ARROW-1926 - [GLib] Add garrow_timestamp_data_type_get_unit()
• ARROW-1930 - [C++] Implement Slice for ChunkedArray and Column
• ARROW-1931 - [C++] w4996 warning due to std::tr1 failing builds on Visual Studio 2017
• ARROW-1965 - [GLib] Add garrow_array_builder_get_value_data_type() and garrow_array_builder_get_value_type()
• ARROW-1970 - [GLib] Add garrow_chunked_array_get_value_data_type() and garrow_chunked_array_get_value_type()
• ARROW-2166 - [GLib] Implement Slice for Column
• ARROW-2176 - [C++] Extend DictionaryBuilder to support delta dictionaries
• ARROW-2190 - [GLib] Add add/remove field functions for RecordBatch.
• ARROW-2205 - [Python] Option for integer object nulls
• ARROW-2252 - [Python] Create buffer from address, size and base
• ARROW-2253 - [Python] Support __eq__ on scalar values
• ARROW-2262 - [Python] Support slicing on pyarrow.ChunkedArray
• ARROW-232 - C++/Parquet: Support writing chunked arrays as part of a table
• ARROW-633 - [Java] Add support for FixedSizeBinary type
• ARROW-634 - Add integration tests for FixedSizeBinary
• ARROW-969 - [C++/Python] Add add/remove field functions for RecordBatch

Sub-task

• ARROW-1815 - [Java] Rename MapVector to StructVector

Task

• ARROW-2052 - Unify OwnedRef and ScopedRef
• ARROW-2054 - Compilation warnings
• ARROW-2108 - [Python] Update instructions for ASV
• ARROW-2114 - [Python] Pull latest docker manylinux1 image
• ARROW-2123 - [JS] Upgrade to TS 2.7.1
• ARROW-2134 - [CI] Make Travis commit inspection more robust
• ARROW-2149 - [Python] reorganize test_convert_pandas.py
• ARROW-2156 - [CI] Isolate Sphinx dependencies
• ARROW-2197 - Document "undefined symbol" issue and workaround
• ARROW-2239 - [C++] Update build docs for Windows
• ARROW-2309 - [C++] Use std::make_unsigned

Test

• ARROW-1589 - [C++] Fuzzing for certain input formats

Apache Arrow 0.8.0 (12 December 2017)

Bug

• ARROW-1282 - Large memory reallocation by Arrow causes hang in jemalloc
• ARROW-1341 - [C++] Deprecate arrow::MakeTable in favor of new ctor from ARROW-1334
• ARROW-1347 - [JAVA] List null type should use consistent name for inner field
• ARROW-1398 - [Python] No support reading columns of type decimal(19,4)
• ARROW-1409 - [Format] Use for "page" attribute in Buffer in metadata
• ARROW-1540 - [C++] Fix valgrind warnings in cuda-test if possible
• ARROW-1541 - [C++] Race condition with arrow_gpu
• ARROW-1543 - [C++] row_wise_conversion example doesn't correspond to ListBuilder constructor arguments
• ARROW-1555 - [Python] write_to_dataset on s3
• ARROW-1584 - [PYTHON] serialize_pandas on empty dataframe
• ARROW-1585 - serialize_pandas round trip fails on integer columns
• ARROW-1586 - [PYTHON] serialize_pandas roundtrip loses columns name
• ARROW-1609 - Plasma: Build fails with Xcode 9.0
• ARROW-1615 - CXX flags for development more permissive than Travis CI builds
• ARROW-1617 - [Python] Do not use symlinks in python/cmake_modules
• ARROW-1620 - Python: Download Boost in manylinux1 build from bintray
• ARROW-1624 - [C++] Follow up fixes / tweaks to compiler warnings for Plasma / LLVM 4.0, add to readme
• ARROW-1625 - [Serialization] Support OrderedDict properly
• ARROW-1629 - [C++] Fix problematic code paths identified by infer tool
• ARROW-1633 - [Python] numpy "unicode" arrays not understood
• ARROW-1640 - Resolve OpenSSL issues in Travis CI
• ARROW-1647 - [Plasma] Potential bug when reading/writing messages.
• ARROW-1653 - [Plasma] Use static cast to avoid compiler warning.
• ARROW-1656 - [C++] Endianness Macro is Incorrect on Windows And Mac
• ARROW-1657 - [C++] Multithreaded Read Test Failing on Arch Linux
• ARROW-1658 - [Python] Out of bounds dictionary indices causes segfault after converting to pandas
• ARROW-1663 - [Java] Follow up on ARROW-1347 and make schema backward compatible
• ARROW-1670 - [Python] Speed up deserialization code path
• ARROW-1672 - [Python] Failure to write Feather bytes column
• ARROW-1673 - [Python] NumPy boolean arrays get converted to uint8 arrays on NdarrayToTensor roundtrip
• ARROW-1676 - [C++] Correctly truncate oversized validity bitmaps when writing Feather format
• ARROW-1678 - [Python] Incorrect serialization of numpy.float16
• ARROW-1680 - [Python] Timestamp unit change not done in from_pandas() conversion
• ARROW-1686 - Documentation generation script creates "apidocs" directory under site/java
• ARROW-1693 - [JS] Error reading dictionary-encoded integration test files
• ARROW-1695 - [Serialization] Fix reference counting of numpy arrays created in custom serialializer
• ARROW-1698 - [JS] File reader attempts to load the same dictionary batch more than once
• ARROW-1704 - [GLib] Go example in test suite is broken
• ARROW-1708 - [JS] Linter problem breaks master build
• ARROW-1709 - [C++] Decimal.ToString is incorrect for negative scale
• ARROW-1711 - [Python] flake8 checks still not failing builds
• ARROW-1714 - [Python] No named pd.Series name serialized as u'None'
• ARROW-1720 - [Python] Segmentation fault while trying to access an out-of-bound chunk
• ARROW-1723 - Windows: __declspec(dllexport) specified when building arrow static library
• ARROW-1730 - [Python] Incorrect result from pyarrow.array when passing timestamp type
• ARROW-1732 - [Python] RecordBatch.from_pandas fails on DataFrame with no columns when preserve_index=False
• ARROW-1735 - [C++] Cast kernels cannot write into sliced output array
• ARROW-1738 - [Python] Wrong datetime conversion when pa.array with unit
• ARROW-1739 - [Python] Fix usages of assertRaises causing broken build
• ARROW-1742 - C++: clang-format is not detected correct on OSX anymore
• ARROW-1743 - [Python] Table to_pandas fails when index contains categorical column
• ARROW-1745 - Compilation failure on Mac OS in plasma tests
• ARROW-1749 - [C++] Handle range of Decimal128 values that require 39 digits to be displayed
• ARROW-1751 - [Python] Pandas 0.21.0 introduces a breaking API change for MultiIndex construction
• ARROW-1754 - [Python] Fix buggy Parquet roundtrip when an index name is the same as a column name
• ARROW-1756 - [Python] Observed int32 overflow in Feather write/read path
• ARROW-1762 - [C++] unittest failure for language environment
• ARROW-1764 - [Python] Add -c conda-forge for Windows dev installation instructions
• ARROW-1766 - [GLib] Fix failing builds on OSX
• ARROW-1768 - [Python] Fix suppressed exception in ParquetWriter.__del__
• ARROW-1770 - [GLib] Fix GLib compiler warning
• ARROW-1771 - [C++] ARROW-1749 Breaks Public API test in parquet-cpp
• ARROW-1776 - [C++[ arrow::gpu::CudaContext::bytes_allocated() isn't defined
• ARROW-1778 - [Python] Link parquet-cpp statically, privately in manylinux1 wheels
• ARROW-1781 - [CI] OSX Builds on Travis-CI time out often
• ARROW-1788 - Plasma store crashes when trying to abort objects for disconnected client
• ARROW-1791 - Integration tests generate date[DAY] values outside of reasonable range
• ARROW-1793 - [Integration] fix a typo for README.md
• ARROW-1800 - [C++] Fix and simplify random_decimals
• ARROW-1805 - [Python] ignore non-parquet files when exploring dataset
• ARROW-1811 - [C++/Python] Rename all Decimal based APIs to Decimal128
• ARROW-1812 - Plasma store modifies hash table while iterating during client disconnect
• ARROW-1829 - [Plasma] Clean up eviction policy bookkeeping
• ARROW-1830 - [Python] Error when loading all the files in a dictionary
• ARROW-1836 - [C++] Fix C4996 warning from arrow/util/variant.h on MSVC builds
• ARROW-1840 - [Website] The installation command failed on Windows10 anaconda environment.
• ARROW-1845 - [Python] Expose Decimal128Type
• ARROW-1852 - [Plasma] Make retrieving manager file descriptor const
• ARROW-1853 - [Plasma] Fix off-by-one error in retry processing
• ARROW-1863 - [Python] PyObjectStringify could render bytes-like output for more types of objects
• ARROW-1865 - [C++] Adding a column to an empty Table fails
• ARROW-1869 - Fix typo in LowCostIdentityHashMap
• ARROW-1871 - [Python/C++] Appending Python Decimals with different scales requires rescaling
• ARROW-1873 - [Python] Segmentation fault when loading total 2GB of parquet files
• ARROW-1877 - Incorrect comparison in JsonStringArrayList.equals
• ARROW-1879 - [Python] Dask integration tests are not skipped if dask is not installed
• ARROW-1881 - [Python] setuptools_scm picks up JS version tags
• ARROW-1882 - [C++] Reintroduce DictionaryBuilder
• ARROW-1883 - [Python] BUG: Table.to_pandas metadata checking fails if columns are not present
• ARROW-1889 - [Python] --exclude is not available in older git versions
• ARROW-1890 - [Python] Masking for date32 arrays not working
• ARROW-1891 - [Python] NaT date32 values are only converted to nulls if from_pandas is used
• ARROW-1892 - [Python] Unknown list item type: binary
• ARROW-1893 - [Python] test_primitive_serialization fails on Python 2.7.3
• ARROW-1895 - [Python] Add field_name to pandas index metadata
• ARROW-1897 - [Python] Incorrect numpy_type for pandas metadata of Categoricals
• ARROW-1904 - [C++] Deprecate PrimitiveArray::raw_values
• ARROW-1906 - [Python] Creating a pyarrow.Array with timestamp of different unit is not casted
• ARROW-1908 - [Python] Construction of arrow table from pandas DataFrame with duplicate column names crashes
• ARROW-1910 - CPP README Brewfile link incorrect
• ARROW-1914 - [C++] make -j may fail to build with -DARROW_GPU=on
• ARROW-1915 - [Python] Parquet tests should be optional
• ARROW-1916 - [Java] Do not exclude java/dev/checkstyle from source releases
• ARROW-1917 - [GLib] Must set GI_TYPELIB_PATH in verify-release-candidate.sh
• ARROW-226 - [C++] libhdfs: feedback to help determining cause of failure in opening file path
• ARROW-641 - [C++] Do not build/run io-hdfs-test if ARROW_HDFS=off

Improvement

• ARROW-1087 - [Python] add get_include to expose directory containing header files
• ARROW-1134 - [C++] Allow C++/CLI projects to build with Arrow
• ARROW-1178 - [Python] Create alternative to Table.from_pandas that yields a list of RecordBatch objects with a given chunk size
• ARROW-1226 - [C++] Improve / correct doxygen function documentation in arrow::ipc
• ARROW-1371 - [Website] Add "Powered By" page to the website
• ARROW-1455 - [Python] Add Dockerfile for validating Dask integration outside of usual CI
• ARROW-1488 - [C++] Implement ArrayBuilder::Finish in terms of internal::ArrayData
• ARROW-1498 - [GitHub] Add CONTRIBUTING.md and ISSUE_TEMPLATE.md
• ARROW-1503 - [Python] Add serialization callbacks for pandas objects in pyarrow.serialize
• ARROW-1522 - [C++] Support pyarrow.Buffer as built-in type in pyarrow.serialize
• ARROW-1523 - [C++] Add helper data struct with methods for reading a validity bitmap possibly having a non-zero offset
• ARROW-1524 - [C++] More graceful solution for handling non-zero offsets on inputs and outputs in compute library
• ARROW-1525 - [C++] Change functions in arrow/compare.h to not return Status
• ARROW-1526 - [Python] Unit tests to exercise code path in PARQUET-1100
• ARROW-1535 - [Python] Enable sdist source tarballs to build assuming that Arrow C++ libraries are available on the host system
• ARROW-1538 - [C++] Support Ubuntu 14.04 in .deb packaging automation
• ARROW-1539 - [C++] Remove functions deprecated as of 0.7.0 and prior releases
• ARROW-1556 - [C++] Incorporate AssertArraysEqual function from PARQUET-1100 patch
• ARROW-1588 - [C++/Format] Harden Decimal Format
• ARROW-1593 - [PYTHON] serialize_pandas should pass through the preserve_index keyword
• ARROW-1594 - [Python] Enable multi-threaded conversions in Table.from_pandas
• ARROW-1600 - [C++] Zero-copy Buffer constructor from std::string
• ARROW-1602 - [C++] Add IsValid/IsNotNull method to arrow::Array
• ARROW-1603 - [C++] Add BinaryArray method to get a value as a std::string
• ARROW-1604 - [Python] Support common type aliases in cast(...) and various type= arguments
• ARROW-1605 - [Python] pyarrow.array should be able to yield smaller integer types without an explicit cast
• ARROW-1607 - [C++] Implement DictionaryBuilder for Decimals
• ARROW-1613 - [Java] ArrowReader should not close the input ReadChannel
• ARROW-1616 - [Python] Add "write" method to RecordBatchStreamWriter that dispatches to write_table/write_back as appropriate
• ARROW-1626 - Add make targets to run the inter-procedural static analysis tool called "infer".
• ARROW-1627 - [JAVA] Reduce heap usage(Phase 2) - memory footprint in AllocationManager.BufferLedger
• ARROW-1630 - [Serialization] Support Python datetime objects
• ARROW-1635 - Add release management guide for PMCs
• ARROW-1641 - [C++] Do not include in public headers
• ARROW-1651 - [JS] Lazy row accessor in Table
• ARROW-1652 - [JS] Separate Vector into BatchVector and CompositeVector
• ARROW-1654 - [Python] pa.DataType cannot be pickled
• ARROW-1662 - Move OSX Dependency management into brew bundle Brewfiles
• ARROW-1665 - [Serialization] Support more custom datatypes in the default serialization context
• ARROW-1666 - [GLib] Enable gtk-doc on Travis CI Mac environment
• ARROW-1671 - [C++] Change arrow::MakeArray to not return Status
• ARROW-1675 - [Python] Use RecordBatch.from_pandas in FeatherWriter.write
• ARROW-1677 - [Blog] Add blog post on Ray and Arrow Python serialization
• ARROW-1679 - [GLib] Add garrow_record_batch_reader_read_next()
• ARROW-1683 - [Python] Restore "TimestampType" to pyarrow namespace
• ARROW-1684 - [Python] Simplify user API for reading nested Parquet columns
• ARROW-1689 - [Python] Categorical Indices Should Be Zero-Copy
• ARROW-1691 - [Java] Conform Java Decimal type implementation to format decisions in ARROW-1588
• ARROW-1701 - [Serialization] Support zero copy PyTorch Tensor serialization
• ARROW-1702 - Update jemalloc in manylinux1 build
• ARROW-1703 - [C++] Vendor exact version of jemalloc we depend on
• ARROW-1707 - Update dev README after movement to GitBox
• ARROW-1716 - [Format/JSON] Use string integer value for Decimals in JSON
• ARROW-1721 - [Python] Support null mask in places where it isn't supported in numpy_to_arrow.cc
• ARROW-1724 - [Packaging] Support Ubuntu 17.10
• ARROW-1725 - [Packaging] Upload .deb for Ubuntu 17.10
• ARROW-1726 - [GLib] Add setup description to verify C GLib build
• ARROW-1727 - [Format] Expand Arrow streaming format to permit new dictionaries and deltas / additions to existing dictionaries
• ARROW-1728 - [C++] Run clang-format checks in Travis CI
• ARROW-1737 - [GLib] Use G_DECLARE_DERIVABLE_TYPE
• ARROW-1746 - [Python] Add build dependencies for Arch Linux
• ARROW-1747 - [C++] Don't export symbols of statically linked libraries
• ARROW-1750 - [C++] Remove the need for arrow/util/random.h
• ARROW-1753 - [Python] Provide for matching subclasses with register_type in serialization context
• ARROW-1755 - [C++] Add build options for MSVC to use static runtime libraries
• ARROW-1758 - [Python] Remove pickle=True option for object serialization
• ARROW-1763 - [Python] DataType should be hashable
• ARROW-1765 - [Doc] Use dependencies from conda in C++ docker build
• ARROW-1785 - [Format/C++/Java] Remove VectorLayout metadata from Flatbuffers metadata
• ARROW-1787 - [Python] Support reading parquet files into DataFrames in a backward compatible way
• ARROW-1794 - [C++/Python] Rename DecimalArray to Decimal128Array
• ARROW-1801 - [Docs] Update install instructions to use red-data-tools repos
• ARROW-1808 - [C++] Make RecordBatch interface virtual to permit record batches that lazy-materialize columns
• ARROW-1809 - [GLib] Use .xml instead of .sgml for GTK-Doc main file
• ARROW-1810 - [Plasma] Remove test shell scripts
• ARROW-1817 - Configure JsonFileReader to read NaN for floats
• ARROW-1826 - [JAVA] Avoid branching at cell level (copyFrom)
• ARROW-1828 - [C++] Implement hash kernel specialization for BooleanType
• ARROW-1834 - [Doc] Build documentation in separate build folders
• ARROW-1838 - [C++] Use compute::Datum uniformly for input argument to kernels
• ARROW-1841 - [JS] Update text-encoding-utf-8 and tslib for node ESModules support
• ARROW-1849 - [GLib] Add input checks to GArrowRecordBatch
• ARROW-1850 - [C++] Use const void* in Writable::Write instead of const uint8_t*
• ARROW-1854 - [Python] Improve performance of serializing object dtype ndarrays
• ARROW-1855 - [GLib] Add workaround for build failure on macOS
• ARROW-1864 - [Java] Upgrade Netty to 4.1.x
• ARROW-1884 - [C++] Make JsonReader/JsonWriter classes internal APIs
• ARROW-1901 - [Python] Support recursive mkdir for DaskFilesystem
• ARROW-1902 - [Python] Remove mkdir race condition from write_to_dataset
• ARROW-1905 - [Python] Add more functions for checking exact types in pyarrow.types
• ARROW-1911 - Add Graphistry to Arrow JS proof points
• ARROW-905 - [Docs] Add Dockerfile for reproducible documentation generation
• ARROW-942 - Support integration testing on Python 2.7
• ARROW-950 - [Site] Add Google Analytics tag

New Feature

• ARROW-1032 - [JS] Support custom_metadata
• ARROW-1047 - [Java] Add generalized stream writer and reader interfaces that are decoupled from IO / message framing
• ARROW-1114 - [C++] Create Record Batch Builder class as a reusable and efficient way to transpose row-by-row data to columns
• ARROW-1250 - [Python] Define API for user type checking of array types
• ARROW-1482 - [C++] Implement casts between date32 and date64
• ARROW-1483 - [C++] Implement casts between time32 and time64
• ARROW-1484 - [C++] Implement (safe and unsafe) casts between timestamps and times of different units
• ARROW-1486 - [C++] Decide if arrow::RecordBatch needs to be copyable
• ARROW-1487 - [C++] Implement casts from List to List, where a cast function is defined from any A to B
• ARROW-1559 - [C++] Kernel implementations for "unique" (compute distinct elements of array)
• ARROW-1573 - [C++] Implement stateful kernel function that uses DictionaryBuilder to compute dictionary indices
• ARROW-1575 - [Python] Add pyarrow.column factory function
• ARROW-1577 - [JS] Package release script for NPM modules
• ARROW-1631 - [C++] Add GRPC to ThirdpartyToolchain.cmake
• ARROW-1637 - [C++] IPC round-trip for null type
• ARROW-1648 - C++: Add cast from Dictionary[NullType] to NullType
• ARROW-1649 - C++: Print number of nulls in PrettyPrint for NullArray
• ARROW-1667 - [GLib] Support Meson
• ARROW-1685 - [GLib] Add GArrowTableReader
• ARROW-1690 - [GLib] Add garrow_array_is_valid()
• ARROW-1697 - [GitHub] Add ISSUE_TEMPLATE.md
• ARROW-1718 - [Python] Implement casts from timestamp to date32/date64 and support in Array.from_pandas
• ARROW-1734 - C++/Python: Add cast function on Column-level
• ARROW-1736 - [GLib] Add GArrowCastOptions:allow-time-truncate
• ARROW-1748 - [GLib] Add GArrowRecordBatchBuilder
• ARROW-1752 - [Packaging] Add GPU packages for Debian and Ubuntu
• ARROW-1767 - [C++] Support file reads and writes over 2GB on Windows
• ARROW-1772 - [C++] Add public-api-test module in style of parquet-cpp
• ARROW-1773 - [C++] Add casts from date/time types to compatible signed integers
• ARROW-1775 - Ability to abort created but unsealed Plasma objects
• ARROW-1777 - [C++] Add static ctor ArrayData::Make for nicer syntax in places
• ARROW-1782 - [Python] Expose compressors as pyarrow.compress, pyarrow.decompress
• ARROW-1783 - [Python] Convert SerializedPyObject to/from sequence of component buffers with minimal memory allocation / copying
• ARROW-1784 - [Python] Read and write pandas.DataFrame in pyarrow.serialize by decomposing the BlockManager rather than coercing to Arrow format
• ARROW-1802 - [GLib] Add Arrow GPU support
• ARROW-1806 - [GLib] Add garrow_record_batch_writer_write_table()
• ARROW-1844 - [C++] Basic benchmark suite for hash kernels
• ARROW-1857 - [Python] Add switch for boost linkage with static parquet in wheels
• ARROW-1859 - [GLib] Add GArrowDictionaryDataType
• ARROW-1862 - [GLib] Add GArrowDictionaryArray
• ARROW-1874 - [GLib] Add garrow_array_unique()
• ARROW-1878 - [GLib] Add garrow_array_dictionary_encode()
• ARROW-480 - [Python] Add accessors for Parquet column statistics
• ARROW-504 - [Python] Add adapter to write pandas.DataFrame in user-selected chunk size to streaming format
• ARROW-507 - [C++/Python] Construct List container from offsets and values subarrays
• ARROW-541 - [JS] Implement JavaScript-compatible implementation
• ARROW-571 - [Python] Add APIs to build Parquet files incrementally from Arrow tables
• ARROW-587 - Add JIRA fix version to merge tool
• ARROW-609 - [C++] Function for casting from days since UNIX epoch to int64 date
• ARROW-838 - [Python] Efficient construction of arrays from non-pandas 1D NumPy arrays
• ARROW-972 - [Python] Add test cases and basic APIs for UnionArray

Sub-task

• ARROW-1471 - [JAVA] Document requirements and non/requirements for ValueVector updates
• ARROW-1472 - [JAVA] Design updated ValueVector Object Hierarchy
• ARROW-1473 - [JAVA] Create Prototype Code Hierarchy (Implementation Phase 1)
• ARROW-1474 - [JAVA] ValueVector hierarchy (Implementation Phase 2)
• ARROW-1476 - [JAVA] Implement final ValueVector updates
• ARROW-1710 - [Java] Remove non-nullable vectors in new vector class hierarchy
• ARROW-1717 - [Java] Remove public static helper method in vector classes for JSONReader/Writer
• ARROW-1719 - [Java] Remove accessor/mutator
• ARROW-1779 - [Java] Integration test breaks without zeroing out validity vectors
• ARROW-1819 - [Java] Remove legacy vector classes
• ARROW-1867 - [Java] Add BitVector APIs from old vector class
• ARROW-1885 - [Java] Restore previous MapVector class names

Task

• ARROW-1369 - Support boolean types in the javascript arrow reader library
• ARROW-1818 - Examine Java Dependencies
• ARROW-1827 - [Java] Add checkstyle config file and header file

Test

• ARROW-1549 - [JS] Integrate auto-generated Arrow test files
• ARROW-1821 - Add integration test case to explicitly check for optional validity buffer
• ARROW-1839 - [C++/Python] Add Decimal Parquet Read/Write Tests

Apache Arrow 0.7.1 (27 September 2017)

Bug

• ARROW-1497 - [Java] JsonFileReader doesn't set value count for some vectors
• ARROW-1500 - [C++] Result of ftruncate ignored in MemoryMappedFile::Create
• ARROW-1536 - [C++] Do not transitively depend on libboost_system
• ARROW-1542 - [C++] Windows release verification script should not modify conda environment
• ARROW-1544 - [JS] Export Vector type definitions
• ARROW-1545 - Int64Builder should not need int64() as arg
• ARROW-1550 - [Python] Fix flaky test on Windows
• ARROW-1554 - [Python] Document that pip wheels depend on MSVC14 runtime
• ARROW-1557 - [PYTHON] pyarrow.Table.from_arrays doesn't validate names length
• ARROW-1591 - C++: Xcode 9 is not correctly detected
• ARROW-1595 - [Python] Fix package dependency issues causing build failures
• ARROW-1601 - [C++] READ_NEXT_BITSET reads one byte past the last byte on last iteration
• ARROW-1606 - Python: Windows wheels don't include .lib files.
• ARROW-1610 - C++/Python: Only call python-prefix if the default PYTHON_LIBRARY is not present
• ARROW-1611 - Crash in BitmapReader when length is zero

Improvement

• ARROW-1537 - [C++] Support building with full path install_name on macOS
• ARROW-1546 - [GLib] Support GLib 2.40 again
• ARROW-1578 - [C++/Python] Run lint checks in Travis CI to fail for linting issues as early as possible
• ARROW-1608 - Support Release verification script on macOS
• ARROW-1612 - [GLib] add how to install for mac os to README

New Feature

• ARROW-1548 - [GLib] Support build append in builder
• ARROW-1592 - [GLib] Add GArrowUIntArrayBuilder

Test

• ARROW-1529 - [GLib] Fix failure on macOS on Travis CI

Wish

• ARROW-559 - Script to easily verify release in all languages

Apache Arrow 0.7.0 (12 September 2017)

Bug

• ARROW-1302 - C++: ${MAKE} variable not set sometimes on older MacOS installations
• ARROW-1354 - [Python] Segfault in Table.from_pandas with Mixed-Type Categories
• ARROW-1357 - [Python] Data corruption in reading multi-file parquet dataset
• ARROW-1363 - [C++] IPC writer sends buffer layout for dictionary rather than indices
• ARROW-1365 - [Python] Remove usage of removed jemalloc_memory_pool in Python API docs
• ARROW-1373 - [Java] Implement getBuffer() methods at the ValueVector interface
• ARROW-1375 - [C++] Visual Studio 2017 Appveyor builds failing
• ARROW-1379 - [Java] maven dependency issues - both unused and undeclared
• ARROW-1407 - Dictionaries can only hold a maximum of 4096 indices
• ARROW-1411 - [Python] Booleans in Float Columns cause Segfault
• ARROW-1414 - [GLib] Cast after status check
• ARROW-1421 - [Python] pyarrow.serialize cannot serialize a Python dict input
• ARROW-1426 - [Website] The title element of the top page is empty
• ARROW-1429 - [Python] Error loading parquet file with _metadata from HDFS
• ARROW-1430 - [Python] flake8 warnings are not failing CI builds
• ARROW-1434 - [C++/Python] pyarrow.Array.from_pandas does not support datetime64[D] arrays
• ARROW-1435 - [Python] PyArrow not propagating timezone information from Parquet to Python
• ARROW-1439 - [Packaging] Automate updating RPM in RPM build
• ARROW-1443 - [Java] Bug on ArrowBuf.setBytes with unsliced ByteBuffers
• ARROW-1444 - BitVector.splitAndTransfer copies last byte incorrectly
• ARROW-1446 - Python: Writing more than 2^31 rows from pandas dataframe causes row count overflow error
• ARROW-1450 - [Python] Raise proper error if custom serialization handler fails
• ARROW-1452 - [C++] Make UNUSED macro name more unique so it does not conflict with thirdparty projects
• ARROW-1453 - [Python] Implement WriteTensor for non-contiguous tensors
• ARROW-1458 - [Python] Document that HadoopFileSystem.mkdir with create_parents=False has no effect
• ARROW-1459 - [Python] PyArrow fails to load partitioned parquet files with non-primitive types
• ARROW-1461 - [C++] Disable builds using LLVM apt packages temporarily
• ARROW-1467 - [JAVA]: Fix reset() and allocateNew() in Nullable Value Vectors template
• ARROW-1490 - [Java] Allow Travis CI failures for JDK9 for now
• ARROW-1493 - [C++] Flush the output stream at the end of each PrettyPrint function
• ARROW-1495 - [C++] Store shared_ptr to boxed arrays in RecordBatch
• ARROW-1507 - [C++] arrow/compute/api.h can't be used without arrow/array.h
• ARROW-1512 - [Docs] NumericArray has no member named 'raw_data'
• ARROW-1514 - [C++] Fix a typo in document
• ARROW-1527 - Fix Travis JDK9 build
• ARROW-1531 - [C++] Return ToBytes by value from Decimal128
• ARROW-1532 - [Python] Referencing an Empty Schema causes a SegFault
• ARROW-407 - BitVector.copyFromSafe() should re-allocate if necessary instead of returning false
• ARROW-801 - [JAVA] Provide direct access to underlying buffer memory addresses in consistent way without generating garbage or large amount indirections

Improvement

• ARROW-1307 - [Python] Add pandas serialization section + Feather API to Sphinx docs
• ARROW-1317 - [Python] Add function to set Hadoop CLASSPATH
• ARROW-1331 - [Java] Refactor tests
• ARROW-1339 - [C++] Use boost::filesystem for handling of platform-specific file path encodings
• ARROW-1344 - [C++] Calling BufferOutputStream::Write after calling Finish crashes
• ARROW-1348 - [C++/Python] Add release verification script for Windows
• ARROW-1351 - Automate updating CHANGELOG.md as part of release scripts
• ARROW-1352 - [Integration] Improve print formatting for producer, consumer line
• ARROW-1355 - Make arrow buildable with java9
• ARROW-1356 - [Website] Add new committers
• ARROW-1358 - Update source release scripts to account for new SHA checksum policy
• ARROW-1359 - [Python] Add Parquet writer option to normalize field names for use in Spark
• ARROW-1366 - [Python] Add instructions for starting the Plasma store when installing pyarrow from wheels
• ARROW-1372 - [Plasma] Support for storing data in huge pages
• ARROW-1376 - [C++] RecordBatchStreamReader::Open API is inconsistent with writer
• ARROW-1381 - [Python] Improve performance of SerializedPyObject.to_buffer
• ARROW-1383 - [C++] Support std::vector in builder vector appends
• ARROW-1384 - [C++] Add convenience function for serializing a record batch to an IPC message
• ARROW-1386 - [C++] Unpin CMake version in MSVC build toolchain
• ARROW-1395 - [C++] Remove APIs deprecated as of 0.5.0 and later versions
• ARROW-1397 - [Packaging] Use Docker instead of Vagrant
• ARROW-1401 - [C++] Add extra debugging context to failures in RETURN_NOT_OK in debug builds
• ARROW-1402 - [C++] Possibly deprecate public APIs that use MutableBuffer
• ARROW-1404 - [Packaging] Build .deb and .rpm on Travis CI
• ARROW-1405 - [Python] Add logging option for verbose memory allocations
• ARROW-1406 - [Python] Harden user API for generating serialized schema and record batch messages as memoryview-compatible objects
• ARROW-1408 - [C++] Refactor and make IPC read / write APIs more consistent, add appropriate deprecations
• ARROW-1410 - Plasma object store occasionally pauses for a long time
• ARROW-1412 - [Plasma] Add higher level API for putting and getting Python objects
• ARROW-1413 - [C++] Add include-what-you-use configuration
• ARROW-1416 - [Format] Clarify example array in memory layout documentation
• ARROW-1418 - [Python] Introduce SerializationContext to register custom serialization callbacks
• ARROW-1419 - [GLib] Suppress sign-conversion warning on Clang
• ARROW-1427 - [GLib] Add a link to readme of Arrow GLib
• ARROW-1428 - [C++] Append steps to clone source code to README.mb
• ARROW-1432 - [C++] Build bundled jemalloc functions with private prefix
• ARROW-1433 - [C++] Simplify implementation of Array::Slice
• ARROW-1438 - [Plasma] Pull SerializationContext through PlasmaClient put and get
• ARROW-1441 - [Site] Add Ruby to Flexible section
• ARROW-1442 - [Website] Add pointer to nightly conda packages on /install
• ARROW-1447 - [C++] Round of include-what-you-use include cleanups
• ARROW-1448 - [Packaging] Support uploading built .deb and .rpm to Bintray
• ARROW-1449 - Implement Decimal using only Int128
• ARROW-1451 - [C++] Create arrow/io/api.h
• ARROW-1460 - [C++] Upgrade clang-format used to LLVM 4.0
• ARROW-1466 - [C++] Support DecimalArray in arrow::PrettyPrint
• ARROW-1468 - [C++] Append to PrimitiveBuilder from std::vector
• ARROW-1480 - [Python] Improve performance of serializing sets
• ARROW-1494 - [C++] Document that shared_ptr returned by RecordBatch::column needs to be retained
• ARROW-1499 - [Python] Consider adding option to parquet.write_table that sets options for maximum Spark compatibility
• ARROW-1505 - [GLib] Simplify arguments check
• ARROW-1506 - [C++] Support pkg-config for compute modules
• ARROW-1508 - C++: Add support for FixedSizeBinaryType in DictionaryBuilder
• ARROW-1511 - [C++] Deprecate arrow::MakePrimitiveArray
• ARROW-1513 - C++: Add cast from Dictionary to plain arrays
• ARROW-1515 - [GLib] Detect version directly
• ARROW-1516 - [GLib] Update document
• ARROW-1517 - Remove unnecessary temporary in DecimalUtil::ToString function
• ARROW-1519 - [C++] Move DecimalUtil functions to methods on the Int128 class
• ARROW-1528 - [GLib] Resolve include dependency
• ARROW-1530 - [C++] Install arrow/util/parallel.h
• ARROW-594 - [Python] Provide interface to write pyarrow.Table to a stream
• ARROW-786 - [Format] In-memory format for 128-bit Decimals, handling of sign bit
• ARROW-837 - [Python] Expose buffer allocation, FixedSizeBufferWriter
• ARROW-941 - [Docs] Improve "cold start" integration testing instructions

New Feature

• ARROW-1156 - [Python] pyarrow.Array.from_pandas should take a type parameter
• ARROW-1238 - [Java] Add JSON read/write support for decimals for integration tests
• ARROW-1364 - [C++] IPC reader and writer specialized for GPU device memory
• ARROW-1377 - [Python] Add function to assist with benchmarking Parquet scan performance
• ARROW-1387 - [C++] Set up GPU leaf library build toolchain
• ARROW-1392 - [C++] Implement reader and writer IO interfaces for GPU buffers
• ARROW-1396 - [C++] Add PrettyPrint function for Schemas, which also outputs any dictionaries
• ARROW-1399 - [C++] Add CUDA build version in a public header to help prevent ABI conflicts
• ARROW-1400 - [Python] Ability to create partitions when writing to Parquet
• ARROW-1415 - [GLib] Support date32 and date64
• ARROW-1417 - [Python] Allow more generic filesystem objects to be passed to ParquetDataset
• ARROW-1462 - [GLib] Support time array
• ARROW-1479 - [JS] Expand JavaScript implementation
• ARROW-1481 - [C++] Expose type casts as generic callable object that can write into pre-allocated memory
• ARROW-1504 - [GLib] Support timestamp
• ARROW-1510 - [C++] Support cast
• ARROW-229 - [C++] Implement safe casts for primitive types
• ARROW-592 - [C++] Provide .deb and .rpm packages
• ARROW-695 - Integration tests for Decimal types
• ARROW-696 - [C++] Add JSON read/write support for decimals for integration tests
• ARROW-759 - [Python] Implement a transient list serialization function that can handle a mix of scalars, lists, ndarrays, dicts
• ARROW-989 - [Python] Write pyarrow.Table to FileWriter or StreamWriter

Test

• ARROW-1390 - [Python] Extend tests for python serialization

Apache Arrow 0.6.0 (14 August 2017)

Bug

• ARROW-1192 - [JAVA] Improve splitAndTransfer performance for List and Union vectors
• ARROW-1195 - [C++] CpuInfo doesn't get cache size on Windows
• ARROW-1204 - [C++] lz4 ExternalProject fails in Visual Studio 2015
• ARROW-1225 - [Python] pyarrow.array does not attempt to convert bytes to UTF8 when passed a StringType
• ARROW-1237 - [JAVA] Expose the ability to set lastSet
• ARROW-1239 - issue with current version of git-commit-id-plugin
• ARROW-1240 - security: upgrade logback to address CVE-2017-5929
• ARROW-1242 - [Java] security - upgrade Jackson to mitigate 3 CVE vulnerabilities
• ARROW-1245 - [Integration] Java Integration Tests Disabled
• ARROW-1248 - [Python] C linkage warnings in Clang with public Cython API
• ARROW-1249 - [JAVA] Expose the fillEmpties function from NullableVector.mutator
• ARROW-1263 - [C++] CpuInfo should be able to get CPU features on Windows
• ARROW-1265 - [Plasma] Plasma store memory leak warnings in Python test suite
• ARROW-1267 - [Java] Handle zero length case in BitVector.splitAndTransfer
• ARROW-1269 - [Packaging] Add Windows wheel build scripts from ARROW-1068 to arrow-dist
• ARROW-1275 - [C++] Default static library prefix for Snappy should be "_static"
• ARROW-1276 - Cannot serializer empty DataFrame to parquet
• ARROW-1283 - [Java] VectorSchemaRoot should be able to be closed() more than once
• ARROW-1285 - PYTHON: NotImplemented exception creates empty parquet file
• ARROW-1287 - [Python] Emulate "whence" argument of seek in NativeFile
• ARROW-1290 - [C++] Use array capacity doubling in arrow::BufferBuilder
• ARROW-1291 - [Python] pa.RecordBatch.from_pandas doesn't accept DataFrame with numeric column names
• ARROW-1294 - [C++] New Appveyor build failures
• ARROW-1296 - [Java] templates/FixValueVectors reset() method doesn't set allocationSizeInBytes correctly
• ARROW-1300 - [JAVA] Fix ListVector Tests
• ARROW-1306 - [Python] Encoding? issue with error reporting for parquet.read_table
• ARROW-1308 - [C++] ld tries to link arrow_static even when -DARROW_BUILD_STATIC=off
• ARROW-1309 - [Python] Error inferring List type in Array.from_pandas when inner values are all None
• ARROW-1310 - [JAVA] Revert ARROW-886
• ARROW-1312 - [C++] Set default value to ARROW_JEMALLOC to OFF until ARROW-1282 is resolved
• ARROW-1326 - [Python] Fix Sphinx build in Travis CI
• ARROW-1327 - [Python] Failing to release GIL in MemoryMappedFile._open causes deadlock
• ARROW-1328 - [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column values
• ARROW-1330 - [Plasma] Turn on plasma tests on manylinux1
• ARROW-1335 - [C++] PrimitiveArray::raw_values has inconsistent semantics re: offsets compared with subclasses
• ARROW-1338 - [Python] Investigate non-deterministic core dump on Python 2.7, Travis CI builds
• ARROW-1340 - [Java] NullableMapVector field doesn't maintain metadata
• ARROW-1342 - [Python] Support strided array of lists
• ARROW-1343 - [Format/Java/C++] Ensuring encapsulated stream / IPC message sizes are always a multiple of 8
• ARROW-1350 - [C++] Include Plasma source tree in source distribution
• ARROW-187 - [C++] Decide on how pedantic we want to be about exceptions
• ARROW-276 - [JAVA] Nullable Value Vectors should extend BaseValueVector instead of BaseDataValueVector
• ARROW-573 - [Python/C++] Support ordered dictionaries data, pandas Categorical
• ARROW-884 - [C++] Exclude internal classes from documentation
• ARROW-932 - [Python] Fix compiler warnings on MSVC
• ARROW-968 - [Python] RecordBatch [i:j] syntax is incomplete

Improvement

• ARROW-1093 - [Python] Fail Python builds if flake8 yields warnings
• ARROW-1121 - [C++] Improve error message when opening OS file fails
• ARROW-1140 - [C++] Allow optional build of plasma
• ARROW-1149 - [Plasma] Create Cython client library for Plasma
• ARROW-1173 - [Plasma] Blog post for Plasma
• ARROW-1211 - [C++] Consider making default_memory_pool() the default for builder classes
• ARROW-1213 - [Python] Enable s3fs to be used with ParquetDataset and reader/writer functions
• ARROW-1219 - [C++] Use more vanilla Google C++ formatting
• ARROW-1224 - [Format] Clarify language around buffer padding and alignment in IPC
• ARROW-1230 - [Plasma] Install libraries and headers
• ARROW-1243 - [Java] security: upgrade all libraries to latest stable versions
• ARROW-1251 - [Python/C++] Revise build documentation to account for latest build toolchain
• ARROW-1253 - [C++] Use pre-built toolchain libraries where prudent to speed up CI builds
• ARROW-1255 - [Plasma] Check plasma flatbuffer messages with the flatbuffer verifier
• ARROW-1257 - [Plasma] Plasma documentation
• ARROW-1258 - [C++] Suppress dlmalloc warnings on Clang
• ARROW-1259 - [Plasma] Speed up Plasma tests
• ARROW-1260 - [Plasma] Use factory method to create Python PlasmaClient
• ARROW-1264 - [Plasma] Don't exit the Python interpreter if the plasma client can't connect to the store
• ARROW-1274 - [C++] add_compiler_export_flags() throws warning with CMake >= 3.3
• ARROW-1288 - Clean up many ASF license headers
• ARROW-1289 - [Python] Add PYARROW_BUILD_PLASMA option like Parquet
• ARROW-1301 - [C++/Python] Add remaining supported libhdfs UNIX-like filesystem APIs
• ARROW-1303 - [C++] Support downloading Boost
• ARROW-1315 - [GLib] Status check of arrow::ArrayBuilder::Finish() is missing
• ARROW-1323 - [GLib] Add garrow_boolean_array_get_values()
• ARROW-1333 - [Plasma] Sorting example for DataFrames in plasma
• ARROW-1334 - [C++] Instantiate arrow::Table from vector of Array objects (instead of Columns)

New Feature

• ARROW-1076 - [Python] Handle nanosecond timestamps more gracefully when writing to Parquet format
• ARROW-1104 - Integrate in-memory object store from Ray
• ARROW-1246 - [Format] Add Map logical type to metadata
• ARROW-1268 - [Website] Blog post on Arrow integration with Spark
• ARROW-1281 - [C++/Python] Add Docker setup for running HDFS tests and other tests we may not run in Travis CI
• ARROW-1305 - [GLib] Add GArrowIntArrayBuilder
• ARROW-1336 - [C++] Add arrow::schema factory function
• ARROW-439 - [Python] Add option in to_pandas conversions to yield Categorical from String/Binary arrays
• ARROW-622 - [Python] Investigate alternatives to timestamps_to_ms argument in pandas conversion

Task

• ARROW-1270 - [Packaging] Add Python wheel build scripts for macOS to arrow-dist
• ARROW-1272 - [Python] Add script to arrow-dist to generate and upload manylinux1 Python wheels
• ARROW-1273 - [Python] Add convenience functions for reading only Parquet metadata or effective Arrow schema from a particular Parquet file
• ARROW-1297 - 0.6.0 Release
• ARROW-1304 - [Java] Fix checkstyle checks warning

Test

• ARROW-1241 - [C++] Visual Studio 2017 Appveyor build job

Apache Arrow 0.5.0 (23 July 2017)

Bug

• ARROW-1074 - from_pandas doesnt convert ndarray to list
• ARROW-1079 - [Python] Empty "private" directories should be ignored by Parquet interface
• ARROW-1081 - C++: arrow::test::TestBase::MakePrimitive doesn't fill null_bitmap
• ARROW-1096 - [C++] Memory mapping file over 4GB fails on Windows
• ARROW-1097 - Reading tensor needs file to be opened in writeable mode
• ARROW-1098 - Document Error?
• ARROW-1101 - UnionListWriter is not implementing all methods on interface ScalarWriter
• ARROW-1103 - [Python] Utilize pandas metadata from common _metadata Parquet file if it exists
• ARROW-1107 - [JAVA] NullableMapVector getField() should return nullable type
• ARROW-1108 - Check if ArrowBuf is empty buffer in getActualConsumedMemory() and getPossibleConsumedMemory()
• ARROW-1109 - [JAVA] transferOwnership fails when readerIndex is not 0
• ARROW-1110 - [JAVA] make union vector naming consistent
• ARROW-1111 - [JAVA] Make aligning buffers optional, and allow -1 for unknown null count
• ARROW-1112 - [JAVA] Set lastSet for VarLength and List vectors when loading
• ARROW-1113 - [C++] gflags EP build gets triggered (as a no-op) on subsequent calls to make or ninja build
• ARROW-1115 - [C++] Use absolute path for ccache
• ARROW-1117 - [Docs] Minor issues in GLib README
• ARROW-1124 - [Python] pyarrow needs to depend on numpy>=1.10 (not 1.9)
• ARROW-1125 - Python: Table.from_pandas doesn't work anymore on partial schemas
• ARROW-1128 - [Docs] command to build a wheel is not properly rendered
• ARROW-1129 - [C++] Fix Linux toolchain build regression from ARROW-742
• ARROW-1131 - Python: Parquet unit tests are always skipped
• ARROW-1132 - [Python] Unable to write pandas DataFrame w/MultiIndex containing duplicate values to parquet
• ARROW-1136 - [C++/Python] Segfault on empty stream
• ARROW-1138 - Travis: Use OpenJDK7 instead of OracleJDK7
• ARROW-1139 - [C++] dlmalloc doesn't allow arrow to be built with clang 4 or gcc 7.1.1
• ARROW-1141 - on import get libjemalloc.so.2: cannot allocate memory in static TLS block
• ARROW-1143 - C++: Fix comparison of NullArray
• ARROW-1144 - [C++] Remove unused variable
• ARROW-1150 - [C++] AdaptiveIntBuilder compiler warning on MSVC
• ARROW-1152 - [Cython] read_tensor should work with a readable file
• ARROW-1155 - segmentation fault when run pa.Int16Value()
• ARROW-1157 - C++/Python: Decimal templates are not correctly exported on OSX
• ARROW-1159 - [C++] Static data members cannot be accessed from inline functions in Arrow headers by thirdparty users
• ARROW-1162 - Transfer Between Empty Lists Should Not Invoke Callback
• ARROW-1166 - Errors in Struct type's example and missing reference in Layout.md
• ARROW-1167 - [Python] Create chunked BinaryArray in Table.from_pandas when a column's data exceeds 2GB
• ARROW-1168 - [Python] pandas metadata may contain "mixed" data types
• ARROW-1169 - C++: jemalloc externalproject doesn't build with CMake's ninja generator
• ARROW-1170 - C++: ARROW_JEMALLOC=OFF breaks linking on unittest
• ARROW-1174 - [GLib] Investigate root cause of ListArray glib test failure
• ARROW-1177 - [C++] Detect int32 overflow in ListBuilder::Append
• ARROW-1179 - C++: Add missing virtual destructors
• ARROW-1180 - [GLib] garrow_tensor_get_dimension_name() returns invalid address
• ARROW-1181 - [Python] Parquet test fail if not enabled
• ARROW-1182 - C++: Specify BUILD_BYPRODUCTS for zlib and zstd
• ARROW-1186 - [C++] Enable option to build arrow with minimal dependencies needed to build Parquet library
• ARROW-1188 - Segfault when trying to serialize a DataFrame with Null-only Categorical Column
• ARROW-1190 - VectorLoader corrupts vectors with duplicate names
• ARROW-1191 - [JAVA] Implement getField() method for the complex readers
• ARROW-1194 - Getting record batch size with pa.get_record_batch_size returns a size that is too small for pandas DataFrame.
• ARROW-1197 - [GLib] record_batch.hpp Inclusion is missing
• ARROW-1200 - [C++] DictionaryBuilder should use signed integers for indices
• ARROW-1201 - [Python] Incomplete Python types cause a core dump when repr-ing
• ARROW-1203 - [C++] Disallow BinaryBuilder to append byte strings larger than the maximum value of int32_t
• ARROW-1205 - C++: Reference to type objects in ArrayLoader may cause segmentation faults.
• ARROW-1206 - [C++] Enable MSVC builds to work with some compression library support disabled
• ARROW-1208 - [C++] Toolchain build with ZSTD library from conda-forge failure
• ARROW-1215 - [Python] Class methods in API reference
• ARROW-1216 - Numpy arrays cannot be created from Arrow Buffers on Python 2
• ARROW-1218 - Arrow doesn't compile if all compression libraries are deactivated
• ARROW-1222 - [Python] pyarrow.array returns NullArray for array of unsupported Python objects
• ARROW-1223 - [GLib] Fix function name that returns wrapped object
• ARROW-1235 - [C++] macOS linker failure with operator<< and std::ostream
• ARROW-1236 - Library paths in exported pkg-config file are incorrect
• ARROW-601 - Some logical types not supported when loading Parquet
• ARROW-784 - Cleaning up thirdparty toolchain support in Arrow on Windows
• ARROW-992 - [Python] In place development builds do not have a __version__

Improvement

• ARROW-1041 - [Python] Support read_pandas on a directory of Parquet files
• ARROW-1100 - [Python] Add "mode" property to NativeFile instances
• ARROW-1102 - Make MessageSerializer.serializeMessage() public
• ARROW-1120 - [Python] Write support for int96
• ARROW-1137 - Python: Ensure Pandas roundtrip of all-None column
• ARROW-1148 - [C++] Raise minimum CMake version to 3.2
• ARROW-1151 - [C++] Add gcc branch prediction to status check macro
• ARROW-1160 - C++: Implement DictionaryBuilder
• ARROW-1165 - [C++] Refactor PythonDecimalToArrowDecimal to not use templates
• ARROW-1185 - [C++] Clean up arrow::Status implementation, add warn_unused_result attribute for clang
• ARROW-1187 - Serialize a DataFrame with None column
• ARROW-1193 - [C++] Support pkg-config for arrow_python.so
• ARROW-1196 - [C++] Appveyor separate jobs for Debug/Release builds from sources; Build with conda toolchain; Build with NMake Makefiles Generator
• ARROW-1199 - [C++] Introduce mutable POD struct for generic array data
• ARROW-1202 - Remove semicolons from status macros
• ARROW-1217 - [GLib] Add GInputStream based arrow::io::RandomAccessFile
• ARROW-1220 - [C++] Standartize usage of *_HOME cmake script variables for 3rd party libs
• ARROW-1221 - [C++] Pin clang-format version
• ARROW-1229 - [GLib] Follow Reader API change (get -> read)
• ARROW-742 - Handling exceptions during execution of std::wstring_convert
• ARROW-834 - [Python] Support creating Arrow arrays from Python iterables
• ARROW-915 - Struct Array reads limited support
• ARROW-935 - [Java] Build Javadoc in Travis CI
• ARROW-960 - [Python] Add source build guide for macOS + Homebrew
• ARROW-962 - [Python] Add schema attribute to FileReader
• ARROW-966 - [Python] pyarrow.list_ should also accept Field instance
• ARROW-978 - [Python] Use sphinx-bootstrap-theme for Sphinx documentation

New Feature

• ARROW-1048 - Allow user LD_LIBRARY_PATH to be used with source release script
• ARROW-1073 - C++: Adapative integer builder
• ARROW-1095 - [Website] Add Arrow icon asset
• ARROW-111 - [C++] Add static analyzer to tool chain to verify checking of Status returns
• ARROW-1122 - [Website] Guest blog post on Arrow + ODBC from turbodbc
• ARROW-1123 - C++: Make jemalloc the default allocator
• ARROW-1135 - Upgrade Travis CI clang builds to use LLVM 4.0
• ARROW-1142 - [C++] Move over compression library toolchain from parquet-cpp
• ARROW-1145 - [GLib] Add get_values()
• ARROW-1154 - [C++] Migrate more computational utility code from parquet-cpp
• ARROW-1183 - [Python] Implement time type conversions in to_pandas
• ARROW-1198 - Python: Add public C++ API to unwrap PyArrow object
• ARROW-1212 - [GLib] Add garrow_binary_array_get_offsets_buffer()
• ARROW-1214 - [Python] Add classes / functions to enable stream message components to be handled outside of the stream reader class
• ARROW-1227 - [GLib] Support GOutputStream
• ARROW-460 - [C++] Implement JSON round trip for DictionaryArray
• ARROW-462 - [C++] Implement in-memory conversions between non-nested primitive types and DictionaryArray equivalent
• ARROW-575 - Python: Auto-detect nested lists and nested numpy arrays in Pandas
• ARROW-597 - [Python] Add convenience function to yield DataFrame from any object that a StreamReader or FileReader can read from
• ARROW-599 - [C++] Add LZ4 codec to 3rd-party toolchain
• ARROW-600 - [C++] Add ZSTD codec to 3rd-party toolchain
• ARROW-692 - Java<->C++ Integration tests for dictionary-encoded vectors
• ARROW-693 - [Java] Add JSON support for dictionary vectors

Task

• ARROW-1052 - Arrow 0.5.0 release

Test

• ARROW-1228 - [GLib] Test file name should be the same name as target class
• ARROW-1233 - [C++] Validate cmake script resolving of 3rd party linked libs from correct location in toolchain build

Apache Arrow 0.4.1 (9 June 2017)

Bug

• ARROW-1039 - Python: pyarrow.Filesystem.read_parquet causing error if nthreads>1
• ARROW-1050 - [C++] Export arrow::ValidateArray
• ARROW-1051 - [Python] If pyarrow.parquet fails to import due to a shared library ABI conflict, the test_parquet.py tests silently do not run
• ARROW-1056 - [Python] Parquet+HDFS test failure due to writing pandas index
• ARROW-1057 - Fix cmake warning and msvc debug asserts
• ARROW-1062 - [GLib] Examples use old API
• ARROW-1066 - remove warning on feather for pandas >= 0.20.1
• ARROW-1070 - [C++] Feather files for date/time types should be written with the physical types
• ARROW-1075 - [GLib] Build error on macOS
• ARROW-1085 - [java] Follow up on template cleanup. Missing method for IntervalYear
• ARROW-1086 - [Python] pyarrow 0.4.0 on pypi is missing pxd files
• ARROW-1088 - [Python] test_unicode_filename test fails when unicode filenames aren't supported by system
• ARROW-1090 - [Python] build_ext usability
• ARROW-1091 - Decimal scale and precision are flipped
• ARROW-1092 - More Decimal and scale flipped follow-up
• ARROW-1094 - [C++] Incomplete buffer reads in arrow::io::ReadableFile should exactly truncate returned buffer
• ARROW-424 - [C++] Threadsafety in arrow/io/hdfs.h

Improvement

• ARROW-1020 - [Format] Add additional language to Schema.fbs to clarify naive vs. localized Timestamp values
• ARROW-1034 - [Python] Enable creation of binary wheels on Windows / MSVC
• ARROW-1049 - [java] vector template cleanup
• ARROW-1063 - [Website] Blog post and website updates for 0.4.0 release
• ARROW-1078 - [Python] Account for PARQUET-967
• ARROW-1080 - C++: Add tutorial about converting to/from row-wise representation
• ARROW-897 - [GLib] Build arrow-glib as a separate build in the Travis CI build matrix
• ARROW-986 - [Format] Update IPC.md to account for dictionary batches
• ARROW-990 - [JS] Add tslint support for linting TypeScript

Task

• ARROW-1068 - [Python] Create external repo with appveyor.yml configured for building Python wheel installers
• ARROW-1069 - Add instructions for publishing maven artifacts
• ARROW-1084 - Implementations of BufferAllocator should handle Netty's OutOfDirectMemoryError

Test

• ARROW-1060 - [Python] Add unit test for ARROW-1053
• ARROW-1082 - [GLib] Add CI on macOS

Apache Arrow 0.4.0 (22 May 2017)

Bug

• ARROW-1003 - [C++] Hdfs and java dlls fail to load when built for Windows with MSVC
• ARROW-1004 - ArrowInvalid: Invalid: Python object of type float is not None and is not a string, bool, or date object
• ARROW-1017 - Python: Table.to_pandas leaks memory
• ARROW-1023 - Python: Fix bundling of arrow-cpp for macOS
• ARROW-1033 - [Python] pytest discovers scripts/test_leak.py
• ARROW-1046 - [Python] Conform DataFrame metadata to pandas spec
• ARROW-1053 - [Python] Memory leak with RecordBatchFileReader
• ARROW-1054 - [Python] Test suite fails on pandas 0.19.2
• ARROW-1061 - [C++] Harden decimal parsing against invalid strings
• ARROW-1064 - ModuleNotFoundError: No module named 'pyarrow._parquet'
• ARROW-813 - [Python] setup.py sdist must also bundle dependent cmake modules
• ARROW-824 - Date and Time Vectors should reflect timezone-less semantics
• ARROW-856 - CmakeError by Unknown compiler.
• ARROW-881 - [Python] Reconstruct Pandas DataFrame indexes using custom_metadata
• ARROW-909 - libjemalloc.so.2: cannot open shared object file:
• ARROW-939 - Fix division by zero for zero-dimensional Tensors
• ARROW-940 - [JS] Generate multiple sets of artifacts
• ARROW-944 - Python: Compat broken for pandas==0.18.1
• ARROW-948 - [GLib] Update C++ header file list
• ARROW-952 - Compilation error on macOS with clang-802.0.42
• ARROW-958 - [Python] Conda build guide still needs ARROW_HOME, PARQUET_HOME
• ARROW-979 - [Python] Fix setuptools_scm version when release tag is not in the master timeline
• ARROW-991 - [Python] PyArray_SimpleNew should not be used with NPY_DATETIME
• ARROW-995 - [Website] 0.3 release announce has a typo in reference
• ARROW-998 - [Doc] File format documents incorrect schema location

Improvement

• ARROW-1000 - [GLib] Move install document to Website
• ARROW-1001 - [GLib] Unify writer files
• ARROW-1002 - [C++] It is not necessary to add padding after the magic header in the FileWriter implementation
• ARROW-1010 - [Website] Only show English posts in /blog/
• ARROW-1016 - Python: Include C++ headers (optionally) in wheels
• ARROW-1022 - [Python] Add nthreads option to Feather read method
• ARROW-1024 - Python: Update build time numpy version to 1.10.1
• ARROW-1025 - [Website] Improve changelog on website
• ARROW-1027 - [Python] Allow negative indexing in fields/columns on pyarrow Table and Schema objects
• ARROW-1028 - [Python] Documentation updates after ARROW-1008
• ARROW-1029 - [Python] Fix --with-parquet build on Windows, add unit tests to Appveyor
• ARROW-1030 - Python: Account for library versioning in parquet-cpp
• ARROW-1037 - [GLib] Follow reader name change
• ARROW-1038 - [GLib] Follow writer name change
• ARROW-1040 - [GLib] Follow tensor IO
• ARROW-182 - [C++] Remove Array::Validate virtual function and make a separate method
• ARROW-376 - Python: Convert non-range Pandas indices (optionally) to Arrow
• ARROW-532 - [Python] Expand pyarrow.parquet documentation for 0.3 release
• ARROW-579 - Python: Provide redistributable pyarrow wheels on OSX
• ARROW-891 - [Python] Expand Windows build instructions to not require looking at separate C++ docs
• ARROW-899 - [Docs] Add CHANGELOG for 0.3.0
• ARROW-901 - [Python] Write FixedSizeBinary to Parquet
• ARROW-913 - [Python] Only link jemalloc to the Cython extension where it's needed
• ARROW-923 - [Docs] Generate Changelog for website with JIRA links
• ARROW-929 - Move KEYS file to SVN, remove from git
• ARROW-943 - [GLib] Support running unit tests with source archive
• ARROW-945 - [GLib] Add a Lua example to show Torch integration
• ARROW-946 - [GLib] Use "new" instead of "open" for constructor name
• ARROW-947 - [Python] Improve execution time of manylinux1 build
• ARROW-953 - Use cmake / curl from conda-forge in CI builds
• ARROW-954 - Make it possible to compile Arrow with header-only boost
• ARROW-961 - [Python] Rename InMemoryOutputStream to BufferOutputStream
• ARROW-970 - [Python] Accidentally calling pyarrow.Table() should not segfault process
• ARROW-982 - [Website] Improve website front copy to highlight serialization efficiency benefits
• ARROW-984 - [GLib] Add Go examples
• ARROW-985 - [GLib] Update package information
• ARROW-988 - [JS] Add entry to Travis CI matrix
• ARROW-993 - [GLib] Add missing error checks in Go examples
• ARROW-996 - [Website] Add 0.3 release announce in Japanese

New Feature

• ARROW-1008 - [C++] Define abstract interface for stream iteration
• ARROW-1011 - [Format] Clarify requirements around buffer padding in validity bitmaps
• ARROW-1014 - 0.4.0 release
• ARROW-1031 - [GLib] Support pretty print
• ARROW-1044 - [GLib] Support Feather
• ARROW-29 - C++: Add re2 as optional 3rd-party toolchain dependency
• ARROW-446 - [Python] Document NativeFile interfaces, HDFS client in Sphinx
• ARROW-482 - [Java] Provide API access to custom_metadata Field attribute in IPC setting
• ARROW-596 - [Python] Add convenience function to convert pandas.DataFrame to pyarrow.Buffer containing a file or stream representation
• ARROW-714 - [C++] Add import_pyarrow C API in the style of NumPy for thirdparty C++ users
• ARROW-819 - [Python] Define public Cython API
• ARROW-872 - [JS] Read streaming format
• ARROW-873 - [JS] Implement fixed width list type
• ARROW-874 - [JS] Read dictionary-encoded vectors
• ARROW-963 - [GLib] Add equal
• ARROW-967 - [GLib] Support initializing array with buffer
• ARROW-977 - [java] Add Timezone aware timestamp vectors

Task

• ARROW-1015 - [Java] Implement schema-level metadata
• ARROW-629 - [JS] Add unit test suite
• ARROW-956 - remove pandas pre-0.20.0 compat
• ARROW-957 - [Doc] Add HDFS and Windows documents to doxygen output
• ARROW-997 - [Java] Implement transfer in FixedSizeListVector

Apache Arrow 0.3.0 (5 May 2017)

Bug

• ARROW-109 - [C++] Investigate recursive data types limit in flatbuffers
• ARROW-208 - Add checkstyle policy to java project
• ARROW-347 - Add method to pass CallBack when creating a transfer pair
• ARROW-413 - DATE type is not specified clearly
• ARROW-431 - [Python] Review GIL release and acquisition in to_pandas conversion
• ARROW-443 - [Python] Support for converting from strided pandas data in Table.from_pandas
• ARROW-451 - [C++] Override DataType::Equals for other types with additional metadata
• ARROW-454 - pojo.Field doesn't implement hashCode()
• ARROW-526 - [Format] Update IPC.md to account for File format changes and Streaming format
• ARROW-565 - [C++] Examine "Field::dictionary" member
• ARROW-570 - Determine Java tools JAR location from project metadata
• ARROW-584 - [C++] Fix compiler warnings exposed with -Wconversion
• ARROW-588 - [C++] Fix compiler warnings on 32-bit platforms
• ARROW-595 - [Python] StreamReader.schema returns None
• ARROW-604 - Python: boxed Field instances are missing the reference to DataType
• ARROW-613 - [JS] Implement random-access file format
• ARROW-617 - Time type is not specified clearly
• ARROW-619 - Python: Fix typos in setup.py args and LD_LIBRARY_PATH
• ARROW-623 - segfault with __repr__ of empty Field
• ARROW-624 - [C++] Restore MakePrimitiveArray function
• ARROW-627 - [C++] Compatibility macros for exported extern template class declarations
• ARROW-628 - [Python] Install nomkl metapackage when building parquet-cpp for faster Travis builds
• ARROW-630 - [C++] IPC unloading for BooleanArray does not account for offset
• ARROW-636 - [C++] Add Boost / other system requirements to C++ README
• ARROW-639 - [C++] Invalid offset in slices
• ARROW-642 - [Java] Remove temporary file in java/tools
• ARROW-644 - Python: Cython should be a setup-only requirement
• ARROW-652 - Remove trailing f in merge script output
• ARROW-654 - [C++] Support timezone metadata in file/stream formats
• ARROW-668 - [Python] Convert nanosecond timestamps to pandas.Timestamp when converting from TimestampValue
• ARROW-671 - [GLib] License file isn't installed
• ARROW-673 - [Java] Support additional Time metadata
• ARROW-677 - [java] Fix checkstyle jcl-over-slf4j conflict issue
• ARROW-678 - [GLib] Fix dependenciesfff
• ARROW-680 - [C++] Multiarch support impacts user-supplied install prefix
• ARROW-682 - Add self-validation checks in integration tests
• ARROW-683 - [C++] Support date32 (DateUnit::DAY) in IPC metadata, rename date to date64
• ARROW-686 - [C++] Account for time metadata changes, add time32 and time64 types
• ARROW-689 - [GLib] Install header files and documents to wrong directories
• ARROW-691 - [Java] Encode dictionary Int type in message format
• ARROW-697 - [Java] Raise appropriate exceptions when encountering large (> INT32_MAX) record batches
• ARROW-699 - [C++] Arrow dynamic libraries are missed on run of unit tests on Windows
• ARROW-702 - Fix BitVector.copyFromSafe to reAllocate instead of returning false
• ARROW-703 - Fix issue where setValueCount(0) doesn’t work in the case that we’ve shipped vectors across the wire
• ARROW-704 - Fix bad import caused by conflicting changes
• ARROW-709 - [C++] Restore type comparator for DecimalType
• ARROW-713 - [C++] Fix linking issue with ipc benchmark
• ARROW-715 - Python: Explicit pandas import makes it a hard requirement
• ARROW-716 - error building arrow/python
• ARROW-720 - [java] arrow should not have a dependency on slf4j bridges in compile
• ARROW-723 - Arrow freezes on write if chunk_size=0
• ARROW-726 - [C++] PyBuffer dtor may segfault if constructor passed an object not exporting buffer protocol
• ARROW-732 - Schema comparison bugs in struct and union types
• ARROW-736 - [Python] Mixed-type object DataFrame columns should not silently coerce to an Arrow type by default
• ARROW-738 - [Python] Fix manylinux1 packaging
• ARROW-739 - Parallel build fails non-deterministically.
• ARROW-740 - FileReader fails for large objects
• ARROW-747 - [C++] Fix spurious warning caused by passing dl to add_dependencies
• ARROW-749 - [Python] Delete incomplete binary files when writing fails
• ARROW-753 - [Python] Unit tests in arrow/python fail to link on some OS X platforms
• ARROW-756 - [C++] Do not pass -fPIC when compiling with MSVC
• ARROW-757 - [C++] MSVC build fails on googletest when using NMake
• ARROW-762 - Kerberos Problem with PyArrow
• ARROW-776 - [GLib] Cast type is wrong
• ARROW-777 - [Java] Resolve getObject behavior per changes / discussion in ARROW-729
• ARROW-778 - Modify merge tool to work on Windows
• ARROW-781 - [Python/C++] Increase reference count for base object?
• ARROW-783 - Integration tests fail for length-0 record batch
• ARROW-787 - [GLib] Fix compilation errors caused by ARROW-758
• ARROW-793 - [GLib] Wrong indent
• ARROW-794 - [C++] Check whether data is contiguous in ipc::WriteTensor
• ARROW-797 - [Python] Add updated pyarrow. public API listing in Sphinx docs
• ARROW-800 - [C++] Boost headers being transitively included in pyarrow
• ARROW-805 - listing empty HDFS directory returns an error instead of returning empty list
• ARROW-809 - C++: Writing sliced record batch to IPC writes the entire array
• ARROW-812 - Pip install pyarrow on mac failed.
• ARROW-817 - [C++] Fix incorrect code comment from ARROW-722
• ARROW-821 - [Python] Extra file _table_api.h generated during Python build process
• ARROW-822 - [Python] StreamWriter fails to open with socket as sink
• ARROW-826 - Compilation error on Mac with -DARROW_PYTHON=on
• ARROW-829 - Python: Parquet: Dictionary encoding is deactivated if column-wise compression was selected
• ARROW-830 - Python: jemalloc is not anymore publicly exposed
• ARROW-839 - [C++] Portable alternative to PyDate_to_ms function
• ARROW-847 - C++: BUILD_BYPRODUCTS not specified anymore for gtest
• ARROW-852 - Python: Also set Arrow Library PATHS when detection was done through pkg-config
• ARROW-853 - [Python] It is no longer necessary to modify the RPATH of the Cython extensions on many environments
• ARROW-858 - Remove dependency on boost regex
• ARROW-866 - [Python] Error from file object destructor
• ARROW-867 - [Python] Miscellaneous pyarrow MSVC fixes
• ARROW-875 - Nullable variable length vector fillEmpties() fills an extra value
• ARROW-879 - compat with pandas 0.20.0
• ARROW-882 - [C++] On Windows statically built lib file overwrites lib file of shared build
• ARROW-886 - VariableLengthVectors don't reAlloc offsets
• ARROW-887 - [format] For backward compatibility, new unit fields must have default values matching previous implied unit
• ARROW-888 - BitVector transfer() does not transfer ownership
• ARROW-895 - Nullable variable length vector lastSet not set correctly
• ARROW-900 - [Python] UnboundLocalError in ParquetDatasetPiece
• ARROW-903 - [GLib] Remove a needless "."
• ARROW-914 - [C++/Python] Fix Decimal ToBytes
• ARROW-922 - Allow Flatbuffers and RapidJSON to be used locally on Windows
• ARROW-928 - Update CMAKE script to detect unsupported msvc compilers versions
• ARROW-933 - [Python] arrow_python bindings have debug print statement
• ARROW-934 - [GLib] Glib sources missing from result of 02-source.sh
• ARROW-936 - Fix release README
• ARROW-938 - Fix Apache Rat errors from source release build

Improvement

• ARROW-316 - Finalize Date type
• ARROW-542 - [Java] Implement dictionaries in stream/file encoding
• ARROW-563 - C++: Support non-standard gcc version strings
• ARROW-566 - Python: Deterministic position of libarrow in manylinux1 wheels
• ARROW-569 - [C++] Set version for .pc
• ARROW-577 - [C++] Refactor StreamWriter and FileWriter to have private implementations
• ARROW-580 - C++: Also provide jemalloc_X targets if only a static or shared version is found
• ARROW-582 - [Java] Add Date/Time Support to JSON File
• ARROW-589 - C++: Use system provided shared jemalloc if static is unavailable
• ARROW-593 - [C++] Rename ReadableFileInterface to RandomAccessFile
• ARROW-612 - [Java] Field toString should show nullable flag status
• ARROW-615 - Move ByteArrayReadableSeekableByteChannel to vector.util package
• ARROW-631 - [GLib] Import C API (C++ API wrapper) based on GLib from https://github.com/kou/arrow-glib
• ARROW-646 - Cache miniconda packages
• ARROW-647 - [C++] Don't require Boost static libraries to support CentOS 7
• ARROW-648 - [C++] Support multiarch on Debian
• ARROW-650 - [GLib] Follow eadableFileInterface -> RnadomAccessFile change
• ARROW-651 - [C++] Set shared library version for .deb packages
• ARROW-655 - Implement DecimalArray
• ARROW-662 - [Format] Factor Flatbuffer schema metadata into a Schema.fbs
• ARROW-664 - Make C++ Arrow serialization deterministic
• ARROW-674 - [Java] Support additional Timestamp timezone metadata
• ARROW-675 - [GLib] Update package metadata
• ARROW-676 - [java] move from MinorType to FieldType in ValueVectors to carry all the relevant type bits
• ARROW-679 - [Format] Change RecordBatch and Field length members from int to long
• ARROW-681 - [C++] Build Arrow on Windows with dynamically linked boost
• ARROW-684 - Python: More informative message when parquet-cpp but not parquet-arrow is available
• ARROW-688 - [C++] Use CMAKE_INSTALL_INCLUDEDIR for consistency
• ARROW-690 - Only send JIRA updates to [email protected]
• ARROW-700 - Add headroom interface for allocator.
• ARROW-706 - [GLib] Add package install document
• ARROW-707 - Python: All none-Pandas column should be converted to NullArray
• ARROW-708 - [C++] Some IPC code simplification, perf analysis
• ARROW-712 - [C++] Implement Array::Accept as inline visitor
• ARROW-719 - [GLib] Support prepared source archive release
• ARROW-724 - Add "How to Contribute" section to README
• ARROW-725 - [Format] Constant length list type
• ARROW-727 - [Python] Write memoryview-compatible objects in NativeFile.write with zero copy
• ARROW-728 - [C++/Python] Add arrow::Table function for removing a column
• ARROW-731 - [C++] Add shared library related versions to .pc
• ARROW-741 - [Python] Add Python 3.6 to Travis CI
• ARROW-743 - [C++] Consolidate unit tests for code in array.h
• ARROW-744 - [GLib] Re-add an assertion to garrow_table_new() test
• ARROW-745 - [C++] Allow use of system cpplint
• ARROW-746 - [GLib] Add garrow_array_get_data_type()
• ARROW-751 - [Python] Rename all Cython extensions to "private" status with leading underscore
• ARROW-752 - [Python] Construct pyarrow.DictionaryArray from boxed pyarrow array objects
• ARROW-754 - [GLib] Add garrow_array_is_null()
• ARROW-755 - [GLib] Add garrow_array_get_value_type()
• ARROW-758 - [C++] Fix compiler warnings on MSVC x64
• ARROW-761 - [Python] Add function to compute the total size of tensor payloads, including metadata and padding
• ARROW-763 - C++: Use python-config to find libpythonX.X.dylib
• ARROW-765 - [Python] Make generic ArrowException subclass value error
• ARROW-769 - [GLib] Support building without installed Arrow C++
• ARROW-770 - [C++] Move clang-tidy/format config files back to C++ source tree
• ARROW-774 - [GLib] Remove needless LICENSE.txt copy
• ARROW-775 - [Java] add simple constructors to value vectors
• ARROW-779 - [C++/Python] Raise exception if old metadata encountered
• ARROW-782 - [C++] Change struct to class for objects that meet the criteria in the Google style guide
• ARROW-788 - Possible nondeterminism in Tensor serialization code
• ARROW-795 - [C++] Combine libarrow/libarrow_io/libarrow_ipc
• ARROW-802 - [GLib] Add read examples
• ARROW-803 - [GLib] Update package repository URL
• ARROW-804 - [GLib] Update build document
• ARROW-806 - [GLib] Support add/remove a column from table
• ARROW-807 - [GLib] Update "Since" tag
• ARROW-808 - [GLib] Remove needless ignore entries
• ARROW-810 - [GLib] Remove io/ipc prefix
• ARROW-811 - [GLib] Add GArrowBuffer
• ARROW-815 - [Java] Allow for expanding underlying buffer size after allocation
• ARROW-816 - [C++] Use conda packages for RapidJSON, Flatbuffers to speed up builds
• ARROW-818 - [Python] Review public pyarrow. API completeness and update docs
• ARROW-820 - [C++] Build dependencies for Parquet library without arrow support
• ARROW-825 - [Python] Generalize pyarrow.from_pylist to accept any object implementing the PySequence protocol
• ARROW-827 - [Python] Variety of Parquet improvements to support Dask integration
• ARROW-828 - [CPP] Document new requirement (libboost-regex-dev) in README.md
• ARROW-832 - [C++] Upgrade thirdparty gtest to 1.8.0
• ARROW-833 - [Python] "Quickstart" build / environment setup guide for Python developers
• ARROW-841 - [Python] Add pyarrow build to Appveyor
• ARROW-844 - [Format] Revise format/README.md to reflect progress reaching a more complete specification
• ARROW-845 - [Python] Sync FindArrow.cmake changes from parquet-cpp
• ARROW-846 - [GLib] Add GArrowTensor, GArrowInt8Tensor and GArrowUInt8Tensor
• ARROW-848 - [Python] Improvements / fixes to conda quickstart guide
• ARROW-849 - [C++] Add optional $ARROW_BUILD_TOOLCHAIN environment variable option for configuring build environment
• ARROW-857 - [Python] Automate publishing Python documentation to arrow-site
• ARROW-860 - [C++] Decide if typed Tensor subclasses are worthwhile
• ARROW-861 - [Python] Move DEVELOPMENT.md to Sphinx docs
• ARROW-862 - [Python] Improve source build instructions in README
• ARROW-863 - [GLib] Use GBytes to implement zero-copy
• ARROW-864 - [GLib] Unify Array files
• ARROW-868 - [GLib] Use GBytes to reduce copy
• ARROW-871 - [GLib] Unify DataType files
• ARROW-876 - [GLib] Unify ArrayBuffer files
• ARROW-877 - [GLib] Add garrow_array_get_null_bitmap()
• ARROW-878 - [GLib] Add garrow_binary_array_get_buffer()
• ARROW-892 - [GLib] Fix GArrowTensor document
• ARROW-893 - Add GLib document to Web site
• ARROW-894 - [GLib] Add GArrowPoolBuffer
• ARROW-896 - [Docs] Add Jekyll plugin for including rendered Jupyter notebooks on website
• ARROW-898 - [C++] Expand metadata support to field level, provide for sharing instances of KeyValueMetadata
• ARROW-904 - [GLib] Simplify error check codes
• ARROW-907 - C++: Convenience construct Table from schema and arrays
• ARROW-908 - [GLib] Unify OutputStream files
• ARROW-910 - [C++] Write 0-length EOS indicator at end of stream
• ARROW-916 - [GLib] Add GArrowBufferOutputStream
• ARROW-917 - [GLib] Add GArrowBufferReader
• ARROW-918 - [GLib] Use GArrowBuffer for read
• ARROW-919 - [GLib] Use "id" to get type enum value from GArrowDataType
• ARROW-920 - [GLib] Add Lua examples
• ARROW-925 - [GLib] Fix GArrowBufferReader test
• ARROW-930 - javadoc generation fails with java 8
• ARROW-931 - [GLib] Reconstruct input stream

New Feature

• ARROW-231 - C++: Add typed Resize to PoolBuffer
• ARROW-281 - [C++] IPC/RPC support on Win32 platforms
• ARROW-341 - [Python] Making libpyarrow available to third parties
• ARROW-452 - [C++/Python] Merge "Feather" file format implementation
• ARROW-459 - [C++] Implement IPC round trip for DictionaryArray, dictionaries shared across record batches
• ARROW-483 - [C++/Python] Provide access to custom_metadata Field attribute in IPC setting
• ARROW-491 - [C++] Add FixedWidthBinary type
• ARROW-493 - [C++] Allow in-memory array over 2^31 -1 elements but require splitting at IPC / RPC boundaries
• ARROW-502 - [C++/Python] Add MemoryPool implementation that logs allocation activity to std::cout
• ARROW-510 - Add integration tests for date and time types
• ARROW-520 - [C++] Add STL-compliant allocator that hooks into an arrow::MemoryPool
• ARROW-528 - [Python] Support _metadata or _common_metadata files when reading Parquet directories
• ARROW-534 - [C++] Add IPC tests for date/time types
• ARROW-539 - [Python] Support reading Parquet datasets with standard partition directory schemes
• ARROW-550 - [Format] Add a TensorMessage type
• ARROW-552 - [Python] Add scalar value support for Dictionary type
• ARROW-557 - [Python] Explicitly opt in to HDFS unit tests
• ARROW-568 - [C++] Add default implementations for TypeVisitor, ArrayVisitor methods that return NotImplemented
• ARROW-574 - Python: Add support for nested Python lists in Pandas conversion
• ARROW-576 - [C++] Complete round trip Union file/stream IPC tests
• ARROW-578 - [C++] Add CMake option to add custom $CXXFLAGS
• ARROW-598 - [Python] Add support for converting pyarrow.Buffer to a memoryview with zero copy
• ARROW-603 - [C++] Add RecordBatch::Validate method that at least checks that schema matches the array metadata
• ARROW-605 - [C++] Refactor generic ArrayLoader class, support work for Feather merge
• ARROW-606 - [C++] Upgrade to flatbuffers 1.6.0
• ARROW-608 - [Format] Days since epoch date type
• ARROW-610 - [C++] Win32 compatibility in file.cc
• ARROW-616 - [C++] Remove -g flag in release builds
• ARROW-618 - [Python] Implement support for DatetimeTZ custom type from pandas
• ARROW-620 - [C++] Add date/time support to JSON reader/writer for integration testing
• ARROW-621 - [C++] Implement an "inline visitor" template that enables visitor-pattern-like code without virtual function dispatch
• ARROW-625 - [C++] Add time unit to TimeType::ToString
• ARROW-626 - [Python] Enable pyarrow.BufferReader to read from any Python object implementing the buffer/memoryview protocol
• ARROW-632 - [Python] Add support for FixedWidthBinary type
• ARROW-635 - [C++] Add JSON read/write support for FixedWidthBinary
• ARROW-637 - [Format] Add time zone metadata to Timestamp type
• ARROW-656 - [C++] Implement IO interface that can read and write to a fixed-size mutable buffer
• ARROW-657 - [Python] Write and read tensors (with zero copy) into shared memory
• ARROW-658 - [C++] Implement in-memory arrow::Tensor objects
• ARROW-659 - [C++] Add multithreaded memcpy implementation (for hardware where it helps)
• ARROW-660 - [C++] Restore function that can read a complete encapsulated record batch message
• ARROW-661 - [C++] Add a Flatbuffer metadata type that supports array data over 2^31 - 1 elements
• ARROW-663 - [Java] Support additional Time metadata + vector value accessors
• ARROW-669 - [Python] Attach proper tzinfo when computing boxed scalars for TimestampArray
• ARROW-687 - [C++] Build and run full test suite in Appveyor
• ARROW-698 - [C++] Add options to StreamWriter/FileWriter to permit large record batches
• ARROW-701 - [Java] Support additional Date metadata
• ARROW-710 - [Python] Enable Feather APIs to read and write using Python file-like objects
• ARROW-717 - [C++] IPC zero-copy round trips for arrow::Tensor
• ARROW-718 - [Python] Expose arrow::Tensor with conversions to/from NumPy arrays
• ARROW-722 - [Python] pandas conversions for new date and time types/metadata
• ARROW-729 - [Java] Add vector type for 32-bit date as days since UNIX epoch
• ARROW-733 - [C++/Format] Change name of Fixed Width Binary to Fixed Size Binary for consistency
• ARROW-734 - [Python] Support for pyarrow on Windows / MSVC
• ARROW-735 - [C++] Developer instruction document for MSVC on Windows
• ARROW-737 - [C++] Support obtaining mutable slices of mutable buffers
• ARROW-768 - [Java] Change the "boxed" object representation of date and time types
• ARROW-771 - [Python] Add APIs for reading individual Parquet row groups
• ARROW-773 - [C++] Add function to create arrow::Table with column appended to existing table
• ARROW-865 - [Python] Verify Parquet roundtrips for new date/time types
• ARROW-880 - [GLib] Add garrow_primitive_array_get_buffer()
• ARROW-890 - [GLib] Add GArrowMutableBuffer
• ARROW-926 - Update KEYS to include wesm

Task

• ARROW-52 - Set up project blog
• ARROW-670 - Arrow 0.3 release
• ARROW-672 - [Format] Bump metadata version for 0.3 release
• ARROW-748 - [Python] Pin runtime library versions in conda-forge packages to force upgrades
• ARROW-798 - [Docs] Publish Format Markdown documents somehow on arrow.apache.org
• ARROW-869 - [JS] Rename directory to js/
• ARROW-95 - Scaffold Main Documentation using asciidoc
• ARROW-98 - Java: API documentation

Test

• ARROW-836 - Test for timedelta compat with pandas
• ARROW-927 - C++/Python: Add manylinux1 builds to Travis matrix

Apache Arrow 0.2.0 (15 February 2017)

Bug

• ARROW-112 - [C++] Style fix for constants/enums
• ARROW-202 - [C++] Integrate with appveyor ci for windows support and get arrow building on windows
• ARROW-220 - [C++] Build conda artifacts in a build environment with better cross-linux ABI compatibility
• ARROW-224 - [C++] Address static linking of boost dependencies
• ARROW-230 - Python: Do not name modules like native ones (i.e. rename pyarrow.io)
• ARROW-239 - [Python] HdfsFile.read called with no arguments should read remainder of file
• ARROW-261 - [C++] Refactor BinaryArray/StringArray classes to not inherit from ListArray
• ARROW-275 - Add tests for UnionVector in Arrow File
• ARROW-294 - [C++] Do not use fopen / fclose / etc. methods for memory mapped file implementation
• ARROW-322 - [C++] Do not build HDFS IO interface optionally
• ARROW-323 - [Python] Opt-in to PyArrow parquet build rather than skipping silently on failure
• ARROW-334 - [Python] OS X rpath issues on some configurations
• ARROW-337 - UnionListWriter.list() is doing more than it should, this can cause data corruption
• ARROW-339 - Make merge_arrow_pr script work with Python 3
• ARROW-340 - [C++] Opening a writeable file on disk that already exists does not truncate to zero
• ARROW-342 - Set Python version on release
• ARROW-345 - libhdfs integration doesn't work for Mac
• ARROW-346 - Python API Documentation
• ARROW-348 - [Python] CMake build type should be configurable on the command line
• ARROW-349 - Six is missing as a requirement in the python setup.py
• ARROW-351 - Time type has no unit
• ARROW-354 - Connot compare an array of empty strings to another
• ARROW-357 - Default Parquet chunk_size of 64k is too small
• ARROW-358 - [C++] libhdfs can be in non-standard locations in some Hadoop distributions
• ARROW-362 - Python: Calling to_pandas on a table read from Parquet leaks memory
• ARROW-371 - Python: Table with null timestamp becomes float in pandas
• ARROW-375 - columns parameter in parquet.read_table() raises KeyError for valid column
• ARROW-384 - Align Java and C++ RecordBatch data and metadata layout
• ARROW-386 - [Java] Respect case of struct / map field names
• ARROW-387 - [C++] arrow::io::BufferReader does not permit shared memory ownership in zero-copy reads
• ARROW-390 - C++: CMake fails on json-integration-test with ARROW_BUILD_TESTS=OFF
• ARROW-392 - Fix string/binary integration tests
• ARROW-393 - [JAVA] JSON file reader fails to set the buffer size on String data vector
• ARROW-395 - Arrow file format writes record batches in reverse order.
• ARROW-398 - [Java] Java file format requires bitmaps of all 1's to be written when there are no nulls
• ARROW-399 - [Java] ListVector.loadFieldBuffers ignores the ArrowFieldNode length metadata
• ARROW-400 - [Java] ArrowWriter writes length 0 for Struct types
• ARROW-401 - [Java] Floating point vectors should do an approximate comparison in integration tests
• ARROW-402 - [Java] "refCnt gone negative" error in integration tests
• ARROW-403 - [JAVA] UnionVector: Creating a transfer pair doesn't transfer the schema to destination vector
• ARROW-404 - [Python] Closing an HdfsClient while there are still open file handles results in a crash
• ARROW-405 - [C++] Be less stringent about finding include/hdfs.h in HADOOP_HOME
• ARROW-406 - [C++] Large HDFS reads must utilize the set file buffer size when making RPCs
• ARROW-408 - [C++/Python] Remove defunct conda recipes
• ARROW-414 - [Java] "Buffer too large to resize to ..." error
• ARROW-420 - Align Date implementation between Java and C++
• ARROW-421 - [Python] Zero-copy buffers read by pyarrow::PyBytesReader must retain a reference to the parent PyBytes to avoid premature garbage collection issues
• ARROW-422 - C++: IPC should depend on rapidjson_ep if RapidJSON is vendored
• ARROW-429 - git-archive SHA-256 checksums are changing
• ARROW-433 - [Python] Date conversion is locale-dependent
• ARROW-434 - Segfaults and encoding issues in Python Parquet reads
• ARROW-435 - C++: Spelling mistake in if(RAPIDJSON_VENDORED)
• ARROW-437 - [C++] clang compiler warnings from overridden virtual functions
• ARROW-445 - C++: arrow_ipc is built before arrow/ipc/Message_generated.h was generated
• ARROW-447 - Python: Align scalar/pylist string encoding with pandas' one.
• ARROW-455 - [C++] BufferOutputStream dtor does not call Close()
• ARROW-469 - C++: Add option so that resize doesn't decrease the capacity
• ARROW-481 - [Python] Fix Python 2.7 regression in patch for PARQUET-472
• ARROW-486 - [C++] arrow::io::MemoryMappedFile can't be casted to arrow::io::FileInterface
• ARROW-487 - Python: ConvertTableToPandas segfaults if ObjectBlock::Write fails
• ARROW-494 - [C++] When MemoryMappedFile is destructed, memory is unmapped even if buffer referecnes still exist
• ARROW-499 - Update file serialization to use streaming serialization format
• ARROW-505 - [C++] Fix compiler warnings in release mode
• ARROW-511 - [Python] List[T] conversions not implemented for single arrays
• ARROW-513 - [C++] Fix Appveyor build
• ARROW-519 - [C++] Missing vtable in libarrow.dylib on Xcode 6.4
• ARROW-523 - Python: Account for changes in PARQUET-834
• ARROW-533 - [C++] arrow::TimestampArray / TimeArray has a broken constructor
• ARROW-535 - [Python] Add type mapping for NPY_LONGLONG
• ARROW-537 - [C++] StringArray/BinaryArray comparisons may be incorrect when values with non-zero length are null
• ARROW-540 - [C++] Fix build in aftermath of ARROW-33
• ARROW-543 - C++: Lazily computed null_counts counts number of non-null entries
• ARROW-544 - [C++] ArrayLoader::LoadBinary fails for length-0 arrays
• ARROW-545 - [Python] Ignore files without .parq or .parquet prefix when reading directory of files
• ARROW-548 - [Python] Add nthreads option to pyarrow.Filesystem.read_parquet
• ARROW-551 - C++: Construction of Column with nullptr Array segfaults
• ARROW-556 - [Integration] Can not run Integration tests if different cpp build path
• ARROW-561 - Update java & python dependencies to improve downstream packaging experience

Improvement

• ARROW-189 - C++: Use ExternalProject to build thirdparty dependencies
• ARROW-191 - Python: Provide infrastructure for manylinux1 wheels
• ARROW-328 - [C++] Return shared_ptr by value instead of const-ref?
• ARROW-330 - [C++] CMake functions to simplify shared / static library configuration
• ARROW-333 - Make writers update their internal schema even when no data is written.
• ARROW-335 - Improve Type apis and toString() by encapsulating flatbuffers better
• ARROW-336 - Run Apache Rat in Travis builds
• ARROW-338 - [C++] Refactor IPC vector "loading" and "unloading" to be based on cleaner visitor pattern
• ARROW-350 - Add Kerberos support to HDFS shim
• ARROW-355 - Add tests for serialising arrays of empty strings to Parquet
• ARROW-356 - Add documentation about reading Parquet
• ARROW-360 - C++: Add method to shrink PoolBuffer using realloc
• ARROW-361 - Python: Support reading a column-selection from Parquet files
• ARROW-365 - Python: Provide Array.to_pandas()
• ARROW-366 - [java] implement Dictionary vector
• ARROW-374 - Python: clarify unicode vs. binary in API
• ARROW-379 - Python: Use setuptools_scm/setuptools_scm_git_archive to provide the version number
• ARROW-380 - [Java] optimize null count when serializing vectors.
• ARROW-382 - Python: Extend API documentation
• ARROW-396 - Python: Add pyarrow.schema.Schema.equals
• ARROW-409 - Python: Change pyarrow.Table.dataframe_from_batches API to create Table instead
• ARROW-411 - [Java] Move Intergration.compare and Intergration.compareSchemas to a public utils class
• ARROW-423 - C++: Define BUILD_BYPRODUCTS in external project to support non-make CMake generators
• ARROW-425 - Python: Expose a C function to convert arrow::Table to pyarrow.Table
• ARROW-426 - Python: Conversion from pyarrow.Array to a Python list
• ARROW-430 - Python: Better version handling
• ARROW-432 - [Python] Avoid unnecessary memory copy in to_pandas conversion by using low-level pandas internals APIs
• ARROW-450 - Python: Fixes for PARQUET-818
• ARROW-457 - Python: Better control over memory pool
• ARROW-458 - Python: Expose jemalloc MemoryPool
• ARROW-463 - C++: Support jemalloc 4.x
• ARROW-466 - C++: ExternalProject for jemalloc
• ARROW-468 - Python: Conversion of nested data in pd.DataFrames to/from Arrow structures
• ARROW-474 - Create an Arrow streaming file fomat
• ARROW-479 - Python: Test for expected schema in Pandas conversion
• ARROW-485 - [Java] Users are required to initialize VariableLengthVectors.offsetVector before calling VariableLengthVectors.mutator.getSafe
• ARROW-490 - Python: Update manylinux1 build scripts
• ARROW-524 - [java] provide apis to access nested vectors and buffers
• ARROW-525 - Python: Add more documentation to the package
• ARROW-529 - Python: Add jemalloc and Python 3.6 to manylinux1 build
• ARROW-546 - Python: Account for changes in PARQUET-867
• ARROW-553 - C++: Faster valid bitmap building

New Feature

• ARROW-108 - [C++] Add IPC round trip for union types
• ARROW-221 - Add switch for writing Parquet 1.0 compatible logical types
• ARROW-227 - [C++/Python] Hook arrow_io generic reader / writer interface into arrow_parquet
• ARROW-228 - [Python] Create an Arrow-cpp-compatible interface for reading bytes from Python file-like objects
• ARROW-243 - [C++] Add "driver" option to HdfsClient to choose between libhdfs and libhdfs3 at runtime
• ARROW-303 - [C++] Also build static libraries for leaf libraries
• ARROW-312 - [Python] Provide Python API to read/write the Arrow IPC file format
• ARROW-317 - [C++] Implement zero-copy Slice method on arrow::Buffer that retains reference to parent
• ARROW-33 - C++: Implement zero-copy array slicing
• ARROW-332 - [Python] Add helper function to convert RecordBatch to pandas.DataFrame
• ARROW-363 - Set up Java/C++ integration test harness
• ARROW-369 - [Python] Add ability to convert multiple record batches at once to pandas
• ARROW-373 - [C++] Implement C++ version of JSON file format for testing
• ARROW-377 - Python: Add support for conversion of Pandas.Categorical
• ARROW-381 - [C++] Simplify primitive array type builders to use a default type singleton
• ARROW-383 - [C++] Implement C++ version of ARROW-367 integration test validator
• ARROW-389 - Python: Write Parquet files to pyarrow.io.NativeFile objects
• ARROW-394 - Add integration tests for boolean, list, struct, and other basic types
• ARROW-410 - [C++] Add Flush method to arrow::io::OutputStream
• ARROW-415 - C++: Add Equals implementation to compare Tables
• ARROW-416 - C++: Add Equals implementation to compare Columns
• ARROW-417 - C++: Add Equals implementation to compare ChunkedArrays
• ARROW-418 - [C++] Consolidate array container and builder code, remove arrow/types
• ARROW-419 - [C++] Promote util/{status.h, buffer.h, memory-pool.h} to top level of arrow/ source directory
• ARROW-427 - [C++] Implement dictionary-encoded array container
• ARROW-428 - [Python] Deserialize from Arrow record batches to pandas in parallel using a thread pool
• ARROW-438 - [Python] Concatenate Table instances with equal schemas
• ARROW-440 - [C++] Support pkg-config
• ARROW-441 - [Python] Expose Arrow's file and memory map classes as NativeFile subclasses
• ARROW-442 - [Python] Add public Python API to inspect Parquet file metadata
• ARROW-444 - [Python] Avoid unnecessary memory copies from use of PyBytes_* C APIs
• ARROW-449 - Python: Conversion from pyarrow.{Table,RecordBatch} to a Python dict
• ARROW-456 - C++: Add jemalloc based MemoryPool
• ARROW-461 - [Python] Implement conversion between arrow::DictionaryArray and pandas.Categorical
• ARROW-467 - [Python] Run parquet-cpp unit tests in Travis CI
• ARROW-470 - [Python] Add "FileSystem" abstraction to access directories of files in a uniform way
• ARROW-471 - [Python] Enable ParquetFile to pass down separately-obtained file metadata
• ARROW-472 - [Python] Expose parquet::{SchemaDescriptor, ColumnDescriptor}::Equals
• ARROW-475 - [Python] High level support for reading directories of Parquet files (as a single Arrow table) from supported file system interfaces
• ARROW-476 - [Integration] Add integration tests for Binary / Varbytes type
• ARROW-477 - [Java] Add support for second/microsecond/nanosecond timestamps in-memory and in IPC/JSON layer
• ARROW-478 - [Python] Accept a PyBytes object in the pyarrow.io.BufferReader ctor
• ARROW-484 - Add more detail about what of technology can be found in the Arrow implementations to README
• ARROW-495 - [C++] Add C++ implementation of streaming serialized format
• ARROW-497 - [Java] Integration test harness for streaming format
• ARROW-498 - [C++] Integration test harness for streaming format
• ARROW-503 - [Python] Interface to streaming binary format
• ARROW-508 - [C++] Make file/memory-mapped file interfaces threadsafe
• ARROW-509 - [Python] Add support for PARQUET-835 (parallel column reads)
• ARROW-512 - C++: Add method to check for primitive types
• ARROW-514 - [Python] Accept pyarrow.io.Buffer as input to StreamReader, FileReader classes
• ARROW-515 - [Python] Add StreamReader/FileReader methods that read all record batches as a Table
• ARROW-521 - [C++/Python] Track peak memory use in default MemoryPool
• ARROW-531 - Python: Document jemalloc, extend Pandas section, add Getting Involved
• ARROW-538 - [C++] Set up AddressSanitizer (ASAN) builds
• ARROW-547 - [Python] Expose Array::Slice and RecordBatch::Slice
• ARROW-81 - [Format] Add a Category logical type (distinct from dictionary-encoding)

Task

• ARROW-268 - [C++] Flesh out union implementation to have all required methods for IPC
• ARROW-327 - [Python] Remove conda builds from Travis CI processes
• ARROW-353 - Arrow release 0.2
• ARROW-359 - Need to document ARROW_LIBHDFS_DIR
• ARROW-367 - [java] converter csv/json <=> Arrow file format for Integration tests
• ARROW-368 - Document use of LD_LIBRARY_PATH when using Python
• ARROW-372 - Create JSON arrow file format for integration tests
• ARROW-506 - Implement Arrow Echo server for integration testing
• ARROW-527 - clean drill-module.conf file
• ARROW-558 - Add KEYS files
• ARROW-96 - C++: API documentation using Doxygen
• ARROW-97 - Python: API documentation via sphinx-apidoc

Apache Arrow 0.1.0 (7 October 2016)

Bug

• ARROW-103 - Missing patterns from .gitignore
• ARROW-104 - Update Layout.md based on discussion on the mailing list
• ARROW-105 - Unit tests fail if assertions are disabled
• ARROW-113 - TestValueVector test fails if cannot allocate 2GB of memory
• ARROW-16 - Building cpp issues on XCode 7.2.1
• ARROW-17 - Set some vector fields to default access level for Drill compatibility
• ARROW-18 - Fix bug with decimal precision and scale
• ARROW-185 - [C++] Make sure alignment and memory padding conform to spec
• ARROW-188 - Python: Add numpy as install requirement
• ARROW-193 - For the instruction, typos "int his" should be "in this"
• ARROW-194 - C++: Allow read-only memory mapped source
• ARROW-200 - [Python] Convert Values String looks like it has incorrect error handling
• ARROW-209 - [C++] Broken builds: llvm.org apt repos are unavailable
• ARROW-210 - [C++] Tidy up the type system a little bit
• ARROW-211 - Several typos/errors in Layout.md examples
• ARROW-217 - Fix Travis w.r.t conda 4.1.0 changes
• ARROW-219 - [C++] Passed CMAKE_CXX_FLAGS are being dropped, fix compiler warnings
• ARROW-223 - Do not link against libpython
• ARROW-225 - [C++/Python] master Travis CI build is broken
• ARROW-244 - [C++] Some global APIs of IPC module should be visible to the outside
• ARROW-246 - [Java] UnionVector doesn't call allocateNew() when creating it's vectorType
• ARROW-247 - [C++] Missing explicit destructor in RowBatchReader causes an incomplete type error
• ARROW-250 - Fix for ARROW-246 may cause memory leaks
• ARROW-259 - Use flatbuffer fields in java implementation
• ARROW-265 - Negative decimal values have wrong padding
• ARROW-266 - [C++] Fix the broken build
• ARROW-274 - Make the MapVector nullable
• ARROW-278 - [Format] Struct type name consistency in implementations and metadata
• ARROW-283 - [C++] Update arrow_parquet to account for API changes in PARQUET-573
• ARROW-284 - [C++] Triage builds by disabling Arrow-Parquet module
• ARROW-287 - [java] Make nullable vectors use a BitVecor instead of UInt1Vector for bits
• ARROW-297 - Fix Arrow pom for release
• ARROW-304 - NullableMapReaderImpl.isSet() always returns true
• ARROW-308 - UnionListWriter.setPosition() should not call startList()
• ARROW-309 - Types.getMinorTypeForArrowType() does not work for Union type
• ARROW-313 - XCode 8.0 breaks builds
• ARROW-314 - JSONScalar is unnecessary and unused.
• ARROW-320 - ComplexCopier.copy(FieldReader, FieldWriter) should not start a list if reader is not set
• ARROW-321 - Fix Arrow licences
• ARROW-36 - Remove fixVersions from patch tool (until we have them)
• ARROW-46 - Port DRILL-4410 to Arrow
• ARROW-5 - Error when run maven install
• ARROW-51 - Move ValueVector test from Drill project
• ARROW-55 - Python: fix legacy Python (2.7) tests and add to Travis CI
• ARROW-62 - Format: Are the nulls bits 0 or 1 for null values?
• ARROW-63 - C++: ctest fails if Python 3 is the active Python interpreter
• ARROW-65 - Python: FindPythonLibsNew does not work in a virtualenv
• ARROW-69 - Change permissions for assignable users
• ARROW-72 - FindParquet searches for non-existent header
• ARROW-75 - C++: Fix handling of empty strings
• ARROW-77 - C++: conform null bit interpretation to match ARROW-62
• ARROW-80 - Segmentation fault on len(Array) for empty arrays
• ARROW-88 - C++: Refactor given PARQUET-572
• ARROW-93 - XCode 7.3 breaks builds
• ARROW-94 - Expand list example to clarify null vs empty list

Improvement

• ARROW-10 - Fix mismatch of javadoc names and method parameters
• ARROW-15 - Fix a naming typo for memory.AllocationManager.AllocationOutcome
• ARROW-190 - Python: Provide installable sdist builds
• ARROW-199 - [C++] Refine third party dependency
• ARROW-206 - [C++] Expose an equality API for arrays that compares a range of slots on two arrays
• ARROW-212 - [C++] Clarify the fact that PrimitiveArray is now abstract class
• ARROW-213 - Exposing static arrow build
• ARROW-218 - Add option to use GitHub API token via environment variable when merging PRs
• ARROW-234 - [C++] Build with libhdfs support in arrow_io in conda builds
• ARROW-238 - C++: InternalMemoryPool::Free() should throw an error when there is insufficient allocated memory
• ARROW-245 - [Format] Clarify Arrow's relationship with big endian platforms
• ARROW-252 - Add implementation guidelines to the documentation
• ARROW-253 - Int types should only have width of 8*2^n (8, 16, 32, 64)
• ARROW-254 - Remove Bit type as it is redundant with boolean
• ARROW-255 - Finalize Dictionary representation
• ARROW-256 - Add versioning to the arrow spec.
• ARROW-257 - Add a typeids Vector to Union type
• ARROW-264 - Create an Arrow File format
• ARROW-270 - [Format] Define more generic Interval logical type
• ARROW-271 - Update Field structure to be more explicit
• ARROW-279 - rename vector module to arrow-vector for consistency
• ARROW-280 - [C++] Consolidate file and shared memory IO interfaces
• ARROW-285 - Allow for custom flatc compiler
• ARROW-286 - Build thirdparty dependencies in parallel
• ARROW-289 - Install test-util.h
• ARROW-290 - Specialize alloc() in ArrowBuf
• ARROW-292 - [Java] Upgrade Netty to 4.041
• ARROW-299 - Use absolute namespace in macros
• ARROW-305 - Add compression and use_dictionary options to Parquet interface
• ARROW-306 - Add option to pass cmake arguments via environment variable
• ARROW-315 - Finalize timestamp type
• ARROW-319 - Add canonical Arrow Schema json representation
• ARROW-324 - Update arrow metadata diagram
• ARROW-325 - make TestArrowFile not dependent on timezone
• ARROW-50 - C++: Enable library builds for 3rd-party users without having to build thirdparty googletest
• ARROW-54 - Python: rename package to "pyarrow"
• ARROW-64 - Add zsh support to C++ build scripts
• ARROW-66 - Maybe some missing steps in installation guide
• ARROW-68 - Update setup_build_env and third-party script to be more userfriendly
• ARROW-71 - C++: Add script to run clang-tidy on codebase
• ARROW-73 - Support CMake 2.8
• ARROW-78 - C++: Add constructor for DecimalType
• ARROW-79 - Python: Add benchmarks
• ARROW-8 - Set up Travis CI
• ARROW-85 - C++: memcmp can be avoided in Equal when comparing with the same Buffer
• ARROW-86 - Python: Implement zero-copy Arrow-to-Pandas conversion
• ARROW-87 - Implement Decimal schema conversion for all ways supported in Parquet
• ARROW-89 - Python: Add benchmarks for Arrow<->Pandas conversion
• ARROW-9 - Rename some unchanged "Drill" to "Arrow"
• ARROW-91 - C++: First draft of an adapter class for parquet-cpp's ParquetFileReader that produces Arrow table/row batch objects

New Feature

• ARROW-100 - [C++] Computing RowBatch size
• ARROW-106 - Add IPC round trip for string types (string, char, varchar, binary)
• ARROW-107 - [C++] add ipc round trip for struct types
• ARROW-13 - Add PR merge tool similar to that used in Parquet
• ARROW-19 - C++: Externalize memory allocations and add a MemoryPool abstract interface to builder classes
• ARROW-197 - [Python] Add conda dev recipe for pyarrow
• ARROW-2 - Post Simple Website
• ARROW-20 - C++: Add null count member to Array containers, remove nullable member
• ARROW-201 - C++: Initial ParquetWriter implementation
• ARROW-203 - Python: Basic filename based Parquet read/write
• ARROW-204 - [Python] Automate uploading conda build artifacts for libarrow and pyarrow
• ARROW-21 - C++: Add in-memory schema metadata container
• ARROW-214 - C++: Add String support to Parquet I/O
• ARROW-215 - C++: Support other integer types in Parquet I/O
• ARROW-22 - C++: Add schema adapter routines for converting flat Parquet schemas to in-memory Arrow schemas
• ARROW-222 - [C++] Create prototype file-like interface to HDFS (via libhdfs) and begin defining more general IO interface for Arrow data adapters
• ARROW-23 - C++: Add logical "Column" container for chunked data
• ARROW-233 - [C++] Add visibility defines for limiting shared library symbol visibility
• ARROW-236 - [Python] Enable Parquet read/write to work with HDFS file objects
• ARROW-237 - [C++] Create Arrow specializations of Parquet allocator and read interfaces
• ARROW-24 - C++: Add logical "Table" container
• ARROW-242 - C++/Python: Support Timestamp Data Type
• ARROW-26 - C++: Add developer instructions for building parquet-cpp integration
• ARROW-262 - [Format] Add a new format document for metadata and logical types for messaging and IPC / on-wire/file representations
• ARROW-267 - [C++] C++ implementation of file-like layout for RPC / IPC
• ARROW-28 - C++: Add google/benchmark to the 3rd-party build toolchain
• ARROW-293 - [C++] Implementations of IO interfaces for operating system files
• ARROW-296 - [C++] Remove arrow_parquet C++ module and related parts of build system
• ARROW-3 - Post Initial Arrow Format Spec
• ARROW-30 - Python: pandas/NumPy to/from Arrow conversion routines
• ARROW-301 - [Format] Add some form of user field metadata to IPC schemas
• ARROW-302 - [Python] Add support to use the Arrow file format with file-like objects
• ARROW-31 - Python: basic PyList <-> Arrow marshaling code
• ARROW-318 - [Python] Revise README to reflect current state of project
• ARROW-37 - C++: Represent boolean array data in bit-packed form
• ARROW-4 - Initial Arrow CPP Implementation
• ARROW-42 - Python: Add to Travis CI build
• ARROW-43 - Python: Add rudimentary console __repr__ for array types
• ARROW-44 - Python: Implement basic object model for scalar values (i.e. results of arrow_arr[i])
• ARROW-48 - Python: Add Schema object wrapper
• ARROW-49 - Python: Add Column and Table wrapper interface
• ARROW-53 - Python: Fix RPATH and add source installation instructions
• ARROW-56 - Format: Specify LSB bit ordering in bit arrays
• ARROW-57 - Format: Draft data headers IDL for data interchange
• ARROW-58 - Format: Draft type metadata ("schemas") IDL
• ARROW-59 - Python: Boolean data support for builtin data structures
• ARROW-60 - C++: Struct type builder API
• ARROW-67 - C++: Draft type metadata conversion to/from IPC representation
• ARROW-7 - Add Python library build toolchain
• ARROW-70 - C++: Add "lite" DCHECK macros used in parquet-cpp
• ARROW-76 - Revise format document to include null count, defer non-nullable arrays to the domain of metadata
• ARROW-82 - C++: Implement IPC exchange for List types
• ARROW-90 - Apache Arrow cpp code does not support power architecture
• ARROW-92 - C++: Arrow to Parquet Schema conversion

Task

• ARROW-1 - Import Initial Codebase
• ARROW-101 - Fix java warnings emitted by java compiler
• ARROW-102 - travis-ci support for java project
• ARROW-11 - Mirror JIRA activity to [email protected]
• ARROW-14 - Add JIRA components
• ARROW-251 - [C++] Expose APIs for getting code and message of the status
• ARROW-272 - Arrow release 0.1
• ARROW-298 - create release scripts
• ARROW-35 - Add a short call-to-action / how-to-get-involved to the main README.md

Test

• ARROW-260 - TestValueVector.testFixedVectorReallocation and testVariableVectorReallocation are flaky
• ARROW-83 - Add basic test infrastructure for DecimalType