How to represent received sysex

[jojogib]

Hey eveyone!
I want to represent the value of the incoming sysex on this modulator.
Like is if the incoming message matches with this modulator update value.
I need this for every modulator I will do later on.
Whats the best/simplest methode?
Thank you
howtoreceive.zip

[thethirdapple]

Greetings,

Which version of Ctrlr are you using?
The attached file returns a few xml related error and is not opening in the various versions of Ctrlr which I have tried...

[damiensellier]

Salut Jojo, your panel crashes CTRLR.
I didn't understand exactly what you need.
A sysex message is received by ctrlr, you want to update a specific modulator value from the sysex message right?
It starts with a LUA script assigned the global panel properties "when a panel receives a midi message":

CLICK THE CANVAS and OPEN THE PANEL MODE cmd+E, it's in the middle:

This script has to filter to listen only sysex messages, decode it (to get the values of the different parameters), then update the values of the corresponding panel modulators.

to filter sysex messages on input it works with :
if midi:getType() == 5 then -- it is a SYSEX message

The rest is almost the same as in the following solution by John @dnaldoog but this is for for cc values. You'll need to locate the parameter position and its value in the message though:
#541 (reply in thread)

[jojogib]

Thank you both i got it to work. I have one futher question. I have a very large sysex file > 20kb here is the beginning:

F0 00 20 32 7F 15 20 00 00 24 72 65 76 20 52 31 20 3B 20 46 69 72 6D 77 61 72 65 20 31 2E 31 30 3B 20 42 43 20 4D 61 6E 61 67 65 72 20 34 2E 31 2E 32 F7 F0 00 20 32 7F 15 20 00 01 24 67 6C 6F 62 61 6C F7 F0 00 20 32 7F 15 20 00 02 20 20 2E 6D 69 64 69 6D 6F 64 65 20 55 2D 33 F7 F0 00 20 32 7F 15 20 00 03 20 20 2E 73 74 61 72 74 75 70 20 6C 61 73 74 F7 F0 00 20 32 7F 15 20 00 04 20 20 2E 66 6F 6F 74 73 77 20 61 75 74 6F F7

I wanna do a button to send the whole message at once but I need a buffer like a delay between every F7 F0 . Anyone knows how to do this in lua? Thank you

[jojogib]

yeah i know i tried diffrent values but always with the same result

[thethirdapple]

Greetings,

@jojogib, would you mind sharing your solution to “parsing” of a long sysex string?

The Korg Karma panel i am working thru would be greatly improved with something similar. Its easy enough to switch banks and presets with simple external sysex message, but i noticed that when using the on board buttons to switch banks, the keyboard generates a super long string containing parameter settings relating to the preset…

peace

[dnaldoog]

Greetings,

@jojogib, would you mind sharing your solution to “parsing” of a long sysex string?

The Korg Karma panel i am working thru would be greatly improved with something similar. Its easy enough to switch banks and presets with simple external sysex message, but i noticed that when using the on board buttons to switch banks, the keyboard generates a super long string containing parameter settings relating to the preset…

peace

Hi @thethirdapple

If you are looking to parse incoming Korg sysex, which is a nightmare, I have worked out lua algorithms for rejigging the data i.e Converting "MIDI 7-Bit Data" to "8-Bit Data". I am guessing the Karma uses the same system as other Korg machines.

[thethirdapple]

That sounds super helpful, thank you. I will take another look at the Karma strings it generates and post one in a new thread(dont want to hijack jojgib’s focused questions), its something I didn't want to get stuck on as it is not crucial for my “personal” needs, but would be nifty if the panel gets to a state of public consumption…

[jojogib]

Greetings,

@jojogib, would you mind sharing your solution to “parsing” of a long sysex string?

The Korg Karma panel i am working thru would be greatly improved with something similar. Its easy enough to switch banks and presets with simple external sysex message, but i noticed that when using the on board buttons to switch banks, the keyboard generates a super long string containing parameter settings relating to the preset…

peace
Sorry for my english I dont know the exact terms for google sheets in english.
. I paste the full sysex in goole sheets in one "chamber". Then I used split by F7, so every sysex starts by F0 in a single row. Now F7 is missing because of the spilt so I made one row of F7. For every paramterer I like to change I used single row. Sorry its a little hard to explain. I will post the sheet here.
Unbenannte Tabelle.xlsx

[dnaldoog]

It looks like your sysex in the file has different sizes. You need something like:

buf is the binary contents of a sysex file:

sendBufferContents = function()
panel:setProperty("panelMidiGlobalDelay", 300, true)
    local start, eox = 0, 0 -- initialise
    for i = 0,buf:getSize() - 1 do
        if buf:getByte(i) == 240 then -- F0 start of message
            start = i
        elseif buf:getByte(i) == 247 then -- EOX F7 end of message
            eox = i
            panel:sendMidiMessageNow(CtrlrMidiMessage(buf:getRange(start, eox - start):toHexString(1)))
        end
    end
end

You don't need a timer to delay between messages - you can use:

panel:setProperty("panelMidiGlobalDelay", value, true) where value = delay in milliseconds.

[damiensellier]

You have good eyes my friend! I assumed the messages were all the same size, I'm impressed you had this idea :)
I don't like the midi global delay because if you update a cc value in real time even with 10ms from 0 to 127 at the end you have more than a second of delay. for sysex dumps like this it's ok but after the dump it has to be reset to 0 then to avoid future lag.

[dnaldoog]

You have good eyes my friend! I assumed the messages were all the same size, I'm impressed you had this idea :) I don't like the midi global delay because if you update a cc value in real time even with 10ms from 0 to 127 at the end you have more than a second of delay. for sysex dumps like this it's ok but after the dump it has to be reset to 0 then to avoid future lag.

I thought they were all 51 bytes in length when I first saw it too!

I see what you mean about the global delay thing. It's a new discovery for me, but here is some altered code using a timer — code adapted from a Roland panel of mine that also has variable sized messages inside a dump.

sendBufferContents = function(comp, mouse)
    if fileContentsBuffer:getSize() == 0 then return end
    local t = {}
        local j = 0
        for i = 0, fileContentsBuffer:getSize() - 1 do
            if fileContentsBuffer:getByte(i) == 247 then
                table.insert(t, fileContentsBuffer:getRange(j, (i - j) + 1):toHexString(1))
                j = i + 1
            end
        end

    global_counter = 0
    global_tab = t
    global_delay = panel:getModulatorByName("setTransmitDelay"):getModulatorValue() -- milliseconds

    timer:setCallback(1, timerCallback)
    timer:startTimer(1, global_delay) 
end

timerCallback = function(timerId)
    if timerId == 1 then
        global_counter = global_counter + 1 -- increment global counter
        panel:sendMidiMessageNow(CtrlrMidiMessage(global_tab[global_counter]))
        if global_counter == #global_tab then
            timer:stopTimer(timerId)
        end
    end
end

[jojogib]

Ok thank you I just checkd the panel and its almost what i like to do. But id like to keep it simpler I only need one button and want to predefine delay and the whole sysex string direct in lua. Is it possible to modify this section:

local buf = MemoryBlock()
  fileRead:loadFileAsData(buf)
  fileContentsBuffer = buf
  panel:getLabel("loadL"):setText(fileContentsBuffer:getSize() .. " bytes")
end --function

like buf = F0 00 20 32 7F 15 20 00 00 24 72 65 76 20 52 31 20 3B 20 46 69 72 6D 77 61 72 65 20 31 2E 31 30 3B 20 42 43 20 4D 61 6E 61 67 65 72 20 34 2E 31 2E 32 F7 F0 00 20 32 7F 15 20 00 01 24 67 6C 6F 62 61 6C F7 F0 00 20 32 7F 15 20 00 02 20 20 2E 6D 69 64 69 6D 6F 64 65 20 55 2D 33 F7 F0 00 20 32 7F 15 20 00 03 20 20 2E 73 74 61 72 74 75 70 20 6C 61 73 74 F7 F0 00 20 32 7F 15 20 00 04 20 20 2E 66 6F 6F 74 73 77 20 61 75 74 6F F7 ? thank you

[dnaldoog]

Ok thank you I just checkd the panel and its almost what i like to do. But id like to keep it simpler I only need one button and want to predefine delay and the whole sysex string direct in lua. Is it possible to modify this section:

local buf = MemoryBlock()
  fileRead:loadFileAsData(buf)
  fileContentsBuffer = buf
  panel:getLabel("loadL"):setText(fileContentsBuffer:getSize() .. " bytes")
end --function

like buf = F0 00 20 32 7F 15 20 00 00 24 72 65 76 20 52 31 20 3B 20 46 69 72 6D 77 61 72 65 20 31 2E 31 30 3B 20 42 43 20 4D 61 6E 61 67 65 72 20 34 2E 31 2E 32 F7 F0 00 20 32 7F 15 20 00 01 24 67 6C 6F 62 61 6C F7 F0 00 20 32 7F 15 20 00 02 20 20 2E 6D 69 64 69 6D 6F 64 65 20 55 2D 33 F7 F0 00 20 32 7F 15 20 00 03 20 20 2E 73 74 61 72 74 75 70 20 6C 61 73 74 F7 F0 00 20 32 7F 15 20 00 04 20 20 2E 66 6F 6F 74 73 77 20 61 75 74 6F F7 ? thank you

So the code

local buf = MemoryBlock()
  fileRead:loadFileAsData(buf)
  fileContentsBuffer = buf

is for loading a binary sysex file off the computer.

If you just want that static string every time then create a function that runs when you click on a button that sends that code:

Ok thank you I just checkd the panel and its almost what i like to do. But id like to keep it simpler I only need one button and want to predefine delay and the whole sysex string direct in lua. Is it possible to modify this section:

local buf = MemoryBlock()
  fileRead:loadFileAsData(buf)
  fileContentsBuffer = buf
  panel:getLabel("loadL"):setText(fileContentsBuffer:getSize() .. " bytes")
end --function

like buf = F0 00 20 32 7F 15 20 00 00 24 72 65 76 20 52 31 20 3B 20 46 69 72 6D 77 61 72 65 20 31 2E 31 30 3B 20 42 43 20 4D 61 6E 61 67 65 72 20 34 2E 31 2E 32 F7 F0 00 20 32 7F 15 20 00 01 24 67 6C 6F 62 61 6C F7 F0 00 20 32 7F 15 20 00 02 20 20 2E 6D 69 64 69 6D 6F 64 65 20 55 2D 33 F7 F0 00 20 32 7F 15 20 00 03 20 20 2E 73 74 61 72 74 75 70 20 6C 61 73 74 F7 F0 00 20 32 7F 15 20 00 04 20 20 2E 66 6F 6F 74 73 77 20 61 75 74 6F F7 ? thank you

Yes, like this: Just change the string str as required:

sendBufferContents = function(comp, mouse)
local buf=MemoryBlock()
buf:loadFromHexString(str)
    if buf:getSize() == 0 then return end
    local t = {}
        local j = 0
        for i = 0, buf:getSize() - 1 do
            if buf:getByte(i) == 247 then
                table.insert(t, buf:getRange(j, (i - j) + 1):toHexString(1))
                j = i + 1
            end
        end

    global_counter = 0
    global_tab = t
    global_delay = panel:getModulatorByName("setTransmitDelay"):getModulatorValue() -- milliseconds
	panel:getLabel("loadL"):setText(buf:getSize().." bytes")
    timer:setCallback(1, timerCallback)
    timer:startTimer(1, global_delay) 
end

timerCallback = function(timerId)

    if timerId == 1 then
    	global_counter = global_counter + 1 -- increment global counter
        panel:sendMidiMessageNow(CtrlrMidiMessage(global_tab[global_counter]))
        if global_counter == #global_tab then
            timer:stopTimer(timerId)
        end
    end
end

str="F0 00 20 32 7F 15 20 00 00 24 72 65 76 20 52 31 20 3B 20 46 69 72 6D 77 61 72 65 20 31 2E 31 30 3B 20 42 43 20 4D 61 6E 61 67 65 72 20 34 2E 31 2E 32 F7 F0 00 20 32 7F 15 20 00 01 24 67 6C 6F 62 61 6C F7 F0 00 20 32 7F 15 20 00 02 20 20 2E 6D 69 64 69 6D 6F 64 65 20 55 2D 33 F7 F0 00 20 32 7F 15 20 00 03 20 20 2E 73 74 61 72 74 75 70 20 6C 61 73 74 F7 F0 00 20 32 7F 15 20 00 04 20 20 2E 66 6F 6F 74 73 77 20 61 75 74 6F F7"

[jojogib]

Many thanks. Thats what i was searching for. Thank you