Detect heart rates using a webcam. In the age of lockdown and covid19, it is desirable to be able to measure health metrics via the internet. This heart rate detector is a step in that direction. In the future, this can be overlayed onto video calls, etc to help in tele-medicine.
The system works with just about any video footage and is implemented using NodeJS, Python and OpenCV. The software uses the image’s red channel and measures the average optical intensity in order to estimate the heart rate. As long as the user’s head doesn’t move too much and the lighting is good, it only takes about 15 seconds.
Demo Video: https://www.loom.com/share/c185c4e4115d4e90a46d0d952361c6b8
Demo website: https://myhealthcheckapp.herokuapp.com/
Note: you might see other users
Note: Works best with firefox
Participants:
Ankit Chiplunkar : https://twitter.com/ankitchiplunkar
Animesh Singh : https://twitter.com/animeshsingh38
Code: https://github.com/ankitchiplunkar/myhealthcheck
References:
1. https://www.youtube.com/watch?v=EhZXDgG9oSk
2. https://github.com/dxue2012/python-webcam-flask
Cool idea, but it seems like you have replicated the work of one of your citations https://www.youtube.com/watch?v=EhZXDgG9oSk ? What makes this different?
Standalone vs deployed as a web app
Super! I saw this done by a startup team at a RockHealth conference back in 2012. Any details on what might have changed since then? It's using subtle color variation on the face indicating a pulse, right?
Also think this would be very cool to just overlay on Zoom, for fun.
its finally active as a webapp: https://myhealthcheckapp.herokuapp.com/
Note: you might see other users
Cool!
wow
This is super cool!
Looks good. What kind of model are you using for your detection?
Currently, we aren't using any model here
Interesting, which dataset is this built on? Or heuristic based?
Analytically
This is an interesting idea with immense potential. Especially in times like this when we don't want to overwhelm the healthcare system
Good job!!!
Thank you!
I hope the government doesn't see this project
Hahaha
Good computer vision application. How accurate is it?
Just an MVP, we haven't investigated the accuracy yet.
FYI, if two or more people are using the website at the same time in the output window you can see the other person's feed.
Great idea nonetheless!
Yeah, we found this while developing and mentioned it in the post. It would take a bit more work to get it running correctly. Thanks for the feedback!
It would pair amazingly with my Fitness Camera project! Any idea how much work it would take to port this to Android?
Android also has OpenCv4Android available as a SDK so it won't be that hard
That's super cool!
Thanks!
Pretty cool!
Really cool, love these creative computer vision use-cases. It looked like your heartrate was fluctuating quite a bit during the video -- perhaps a confidence score might be useful.
Yeah that would be great
This was very interesting and impressive! great work :)
Thanks!
Someone actually did it! wow, nice!
Thanks!
very interested to see this!
Thanks!
Quite interesting!
Thanks!
That's really impressive! Nice job!
Thanks!
Will be interested in how it will be done in such a short time. Kudos to you guys.
Thank you so much!
Super cool - I wonder how this changes in efficacy with different types of webcams? Really great idea though! Maybe expand into fever detection later as well!
The results would be varied based on the quality of the feed ig
With a little bit of spice of custom algorithm (maybe deep learning), this idea would be great. Maybe a mobile app with a frozen graph might do wonders for offline usage
Yeah that would be great
I'm very interested to hear about how this would work!
its finally active: https://myhealthcheckapp.herokuapp.com/
Note: you might see other users
Finally it is complete.
I am at ease knowing that someone made this