Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

vector query causes "panic: runtime error: index out of range [417993] with length 417993" #5469

Closed
philrz opened this issue Nov 12, 2024 · 1 comment · Fixed by #5498
Closed
Assignees
Labels
bug Something isn't working

Comments

@philrz
Copy link
Contributor

philrz commented Nov 12, 2024

Repro is with super commit 411514f.

This is a simplification of the bench3/q5 query.

Test data is s3://brim-sampledata/mgbench/bench3.csup.

$ super -version
Version: v1.18.0-142-g411514fd

$ super dev vector query 'where event_type=="temperature" | cut dt := strftime("%Y-%m-%d", log_time)' bench3.csup
panic: runtime error: index out of range [417993] with length 417993

goroutine 1 [running]:
github.com/brimdata/super/runtime/vam/expr/function.(*Strftime).fastPathLoop(0xc000136018?, 0xc0005d0300, 0xc0005d0060, {0xc07c96c000, 0x660c9, 0x0?})
	/Users/phil/work/super/runtime/vam/expr/function/time.go:58 +0x2d6
github.com/brimdata/super/runtime/vam/expr/function.(*Strftime).fastPath(0xc00051a030, 0xc0005d0270, {0xafb3bd0, 0xc0005d02a0})
	/Users/phil/work/super/runtime/vam/expr/function/time.go:40 +0xd4
github.com/brimdata/super/runtime/vam/expr/function.(*Strftime).Call(0xc00051a030, {0xc00052c520, 0x2, 0x0?})
	/Users/phil/work/super/runtime/vam/expr/function/time.go:25 +0x17e
github.com/brimdata/super/vector.Apply(0xb0?, 0xafb38b8?, {0xc00052c520?, 0x1ac000?, 0xc000055a08?})
	/Users/phil/work/super/vector/apply.go:17 +0xa3
github.com/brimdata/super/runtime/vam/expr.(*Call).Eval(0xc00017b360, {0xafb38b8, 0xc00051c090})
	/Users/phil/work/super/runtime/vam/expr/eval.go:39 +0xf4
github.com/brimdata/super/runtime/vam/expr.(*recordExpr).Eval(0xc0006a1340, {0xafb38b8, 0xc00051c090})
	/Users/phil/work/super/runtime/vam/expr/recordexpr.go:38 +0x134
github.com/brimdata/super/runtime/vam/op.(*Yield).Pull(0xc000522e10, 0x0)
	/Users/phil/work/super/runtime/vam/op/yield.go:33 +0x112
github.com/brimdata/super/runtime/vam.(*Materializer).Pull(0x52ff70c0?, 0xf8?)
	/Users/phil/work/super/runtime/vam/materialize.go:25 +0x27
github.com/brimdata/super/zbuf.(*pullerReader).Read(0xc0000bf580)
	/Users/phil/work/super/zbuf/batch.go:193 +0x85
github.com/brimdata/super/zio.CopyWithContext({0xafb3148, 0xbfe9760}, {0x52ff70c0, 0xc000613ad0}, {0xaf99a40, 0xc0000bf580})
	/Users/phil/work/super/zio/zio.go:154 +0x5a
github.com/brimdata/super/zio.Copy(...)
	/Users/phil/work/super/zio/zio.go:146
github.com/brimdata/super/cmd/super/dev/vector/query.(*Command).Run(0xaf99a20?, {0xc00003e2e0, 0x2, 0xc00003e2e0?})
	/Users/phil/work/super/cmd/super/dev/vector/query/command.go:80 +0x5f4
github.com/brimdata/super/pkg/charm.path.run({0xc000697f40, 0x4, 0x4}, {0xc00003e2e0, 0x2, 0x0?})
	/Users/phil/work/super/pkg/charm/path.go:11 +0x7f
github.com/brimdata/super/pkg/charm.(*Spec).Exec(0xbfaf380, {0xc00003e2b0, 0x5, 0x5})
	/Users/phil/work/super/pkg/charm/charm.go:71 +0x105
main.main()
	/Users/phil/work/super/cmd/super/main.go:41 +0x5b
@philrz philrz added the bug Something isn't working label Nov 12, 2024
@philrz philrz changed the title vector query causes "panic: runtime error: index out of range" vector query causes "panic: runtime error: index out of range [417993] with length 417993" Nov 12, 2024
mattnibs added a commit that referenced this issue Nov 23, 2024
mattnibs added a commit that referenced this issue Nov 25, 2024
@philrz
Copy link
Contributor Author

philrz commented Nov 25, 2024

Verified in super commit 7c930f2.

The query now runs successfully without panic.

$ super -version
Version: v1.18.0-169-g7c930f2a

$ super dev vector query 'where event_type=="temperature" | cut dt := strftime("%Y-%m-%d", log_time)' bench3.csup
{dt:"2017-09-07"}
...
{dt:"2019-09-19"}

Thanks @mattnibs!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants