Based on a comment on lobste.rs I moved my to-do list from #Obsidian to a #Forgejo repo's issue tracker and now I'm left wondering why did I not think of this myself. It's got time tracking, I can access it everywhere, it has its own dedicated comment thread to jot down notes, it's perfect.