Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[compiler] Support RMSNorm Op and Fuse #13964

Open
seockho-kim opened this issue Sep 9, 2024 · 3 comments
Open

[compiler] Support RMSNorm Op and Fuse #13964

seockho-kim opened this issue Sep 9, 2024 · 3 comments
Assignees
@seockho-kim
Labels
DRAFT A draft issue or PR for sharing one's current working status and discussion.

Comments

@seockho-kim
Copy link
Contributor

seockho-kim commented Sep 9, 2024 •
edited
Loading

What

To support LLM,

  • Introduce RmsNorm Op and extend circle format.
  • Support RmsNorm Fuse
@seockho-kim seockho-kim self-assigned this Sep 9, 2024
@seockho-kim seockho-kim changed the title Implement RMSNorm fuse tool Support RMSNorm Op and Fuse Sep 9, 2024
@seockho-kim
Copy link
Contributor Author

seockho-kim commented Sep 9, 2024 •
edited
Loading

RMS Norm

image

https://github.com/bzhangGo/rmsnorm

@seockho-kim
Copy link
Contributor Author

Pattern of RMS Norm (need to fuse)

image

@seockho-kim seockho-kim changed the title Support RMSNorm Op and Fuse [compiler] Support RMSNorm Op and Fuse Sep 9, 2024
@seockho-kim seockho-kim added the DRAFT A draft issue or PR for sharing one's current working status and discussion. label Sep 9, 2024
@seockho-kim seockho-kim mentioned this issue Sep 10, 2024
Draft
@seockho-kim
Copy link
Contributor Author

seockho-kim commented Sep 10, 2024 •
edited
Loading

To Do in draft

  • Add RmsNorm op to circle schema
  • Add RmsNorm to luci modules including lang, import, export, interpreter, service, logex, partition
  • Implement RmsNorm Fuse
  • support rmsnorm in circle2circle
  • prepare test recipe
  • Add rmsnorm to circlechef
  • rmsnorm in circledump

This was referenced Sep 11, 2024
Merged
Merged
Merged
Merged
Merged
Merged
Open
Merged
Draft
Open
Merged
This was referenced Sep 19, 2024
Open
Open
Open
Open
Open
Open
Open
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@seockho-kim seockho-kim

Labels
DRAFT A draft issue or PR for sharing one's current working status and discussion.
Projects
[ONE] onert - LLM support
Status: In Progress
Milestone
No milestone
Development

No branches or pull requests
1 participant
@seockho-kim