Yes, I used to index videos on a text file. My intelligent high-tech solution, however ancient, well helped me to a great extent.
Recently, I found Moments Tracker plugin in VLC media player. I felt embarrassed for not searching this earlier.
To install simply download this lua file and copy to
sudo cp 168031-moments_tracker_V1.lua /usr/share/vlc/lua/extensions/
Restart your VLC and navigate to view -> moments tracker.