Generating Custom Feedback & Custom Marks Per Questions

[HxTrinity]

I saw someones nbgrader doing this and I am wondering how I can generate a custom feedback form in the forms that looks like this

Question 1 (repeat_int_str)
Test 0 PASS
    input:      0, 0
    output:     ''
    expected:   ''

Test 1 PASS
    input:      0, 1
    output:     '0'
    expected:   '0'

Test 2 >>FAIL<<
    input:      0, 2
    output:     '000'
    expected:   '00'
    
 
Question 2 (biggest_letter_distance) - 2 Marks Each
Test 0 PASS
    input:      'Hello'
    output:     10
    expected:   10

Test 1 >>FAIL<<
    input:      'Za'
    output:     26
    expected:   25

Test 2 PASS
    input:      'AAAAaaaaAAAAAAAAaaaaaAA'
    output:     0
    expected:   0
    
Test 3 >>EXCEPTION<<
    input:      ''
    output:     IndexError('string index out of range')
    expected:   ''

 

currently I'm doing the most basic autograde test block which is just

assert somefunc(5) == [0,1,2,3,4]
assert  somefunc(7) == [0,1,2,3,4,5,6]
assert somefunc(2) == [0,1]
#etc...

However the issue with this is that it doesn't generate the output above and also it can't give custom marks per question. It will just stop at that specific test case when the student is wrong and the other test cases don't get run and award 0 marks.