We’re good 
Legitimately, I’m with you that the Delete button should be functioning when you’re in “Live Record Mode”. From my POV it is an expected behavior and would justify to a bug report. Very possible it was simply overlooked.
Feel free to write one up at the link below.
https://backstage.polyend.com/w/bug_report/steps/step_1