Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Tensor] Update with scale factor support for quantized data types #2779

Merged
merged 1 commit into from
Nov 4, 2024

Conversation

djeong20
Copy link
Contributor

This pull request aims to enhance the functionality of the Tensor class by enabling it to handle scale factors specifically designed for quantized data types. This patch ensures tensor class accurately represents and processes quantized data while maintaining original features. This update will provide developers with more flexibility when working with quantized models

Self-evaluation:

  1. Build test: [X]Passed [ ]Failed [ ]Skipped
  2. Run test: [X]Passed [ ]Failed [ ]Skipped

This pull request aims to enhance the functionality of the Tensor class by enabling it to handle scale factors specifically designed for quantized data types.
This patch ensures tensor class accurately represents and processes quantized data while maintaining original features.
This update will provide developers with more flexibility when working with quantized models

**Self-evaluation:**
1. Build test: [X]Passed [ ]Failed [ ]Skipped
2. Run test:   [X]Passed [ ]Failed [ ]Skipped

Signed-off-by: Donghyeon Jeong <[email protected]>
@taos-ci
Copy link

taos-ci commented Oct 31, 2024

📝 TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #2779. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/.

@@ -568,7 +586,7 @@ class TensorBase {
* @brief Get size of current tensor
* @retval unsigned int size of the current tensor
*/
size_t size() const { return dim.getDataLen(); }
virtual size_t size() const { return dim.getDataLen(); }
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

size() is now a virtual function since it will be overridden by a quantized tensor that utilizes data packing.

Copy link

@taos-ci taos-ci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@djeong20, 💯 All CI checkers are successfully verified. Thanks.

Copy link
Collaborator

@jijoongmoon jijoongmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@EunjuYang EunjuYang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jijoongmoon jijoongmoon merged commit ad23950 into nnstreamer:main Nov 4, 2024
40 checks passed
@djeong20 djeong20 deleted the tensor/support_scale_factor branch December 9, 2024 07:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants