Update README.md
Browse files
README.md
CHANGED
|
@@ -165,3 +165,36 @@ These issues highlight areas where the model could be improved with more diverse
|
|
| 165 |
### Known Failure Cases
|
| 166 |
<img alt= "Failure Cases" src="https://huggingface.co/cvtechniques/VideoGameHandGestures/resolve/main/failure_cases.png" width="1100" height="700"></img>
|
| 167 |
The model struggled with some of the photos from the RPS dataset as these images contain complex backgrounds, partially occluded hands, or ambiguous gestures.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 165 |
### Known Failure Cases
|
| 166 |
<img alt= "Failure Cases" src="https://huggingface.co/cvtechniques/VideoGameHandGestures/resolve/main/failure_cases.png" width="1100" height="700"></img>
|
| 167 |
The model struggled with some of the photos from the RPS dataset as these images contain complex backgrounds, partially occluded hands, or ambiguous gestures.
|
| 168 |
+
|
| 169 |
+
### Data Biases
|
| 170 |
+
Potential biases include:
|
| 171 |
+
* limited subject diversity
|
| 172 |
+
* similar backgrounds across many images
|
| 173 |
+
* dataset partially composed of stock imagery
|
| 174 |
+
* limited environmental variability
|
| 175 |
+
|
| 176 |
+
### Environmental Limitations
|
| 177 |
+
Model performance may degrade when:
|
| 178 |
+
* lighting conditions vary significantly
|
| 179 |
+
* gestures are performed at unusual angles
|
| 180 |
+
* hands are partially occluded
|
| 181 |
+
* gestures appear at extreme scales or distances
|
| 182 |
+
|
| 183 |
+
### Inappropriate Use Cases
|
| 184 |
+
This model should not be used for:
|
| 185 |
+
* complex gesture recognition (complex 3D control schemes)
|
| 186 |
+
* sign language recognition
|
| 187 |
+
* high-precision human-computer interaction systems
|
| 188 |
+
* any safety-critical applications
|
| 189 |
+
|
| 190 |
+
### Sample Size Limitations
|
| 191 |
+
The dataset is relatively small for object detection training, which may limit generalization to new users or environments.
|
| 192 |
+
Future improvements would to the model would likely be a larger and more diverse dataset. Best course of action would be to remove stock images dataset and culminate gesture videos using diverse individuals, backgrounds, etc.
|
| 193 |
+
***
|
| 194 |
+
# Future Work
|
| 195 |
+
Potential improvements include:
|
| 196 |
+
* collecting a larger and more diverse gesture dataset
|
| 197 |
+
* increasing the number of gesture classes
|
| 198 |
+
* improving image quality and environmental diversity
|
| 199 |
+
* exploring hand keypoint detection models instead of object detection
|
| 200 |
+
* Keypoint estimation could allow detection of more complex hand gestures and improve gesture recognition accuracy.
|