Skip to content

Releases: PyriteAI/x-mlps

v0.5.0

01 Jun 04:28
Compare
Choose a tag to compare

Improve the 1D and 2D shift operators. Specifically:

  • Enable the 1D shift operator to operate on tensors of ndim >= 2.
  • Enable the 2D shift operator to operate on tensors of ndim >= 3. Additionally, remove the height and width arguments to create_shift2d_op and assume the input data has the shape (..., height, width, dim).

v0.4.0

01 Jun 03:05
aee4a55
Compare
Choose a tag to compare

Move to using the Poetry package manager. Additionally, rename SampleDropout to DropPath and support per-sample dropout as implemented in timm.

v0.3.0

01 Mar 06:09
fcbba19
Compare
Choose a tag to compare

Implement two 1D shift operations. In contrast to create_shift2d_op, these operations are useable with sequence data. These operations include:

  • create_shift1d_op
  • create_multishift1d_op

Additionally, update the README and add an RF/ML example to showcase the 1D shift operations.

v0.2.0

03 Jan 02:57
Compare
Choose a tag to compare
  • Implement two FNet inspired blocks.
  • Split _x_mlps.py into several modules to reduce file size.
  • Update README.md

v0.1.0

29 Dec 01:06
db7bb73
Compare
Choose a tag to compare

Initial release. Create core MLP architecture and implement four concrete architectural blocks:

  • MLP-Mixer
  • ResMLP
  • gMLP
  • S^2-MLP