Some of the problems like object detection, speech recognition are common applications that are used in many industries. Several advancements have been made in this aspect to get better accuracy.

Bulky models have been modeled to get better accuracy which has requires high computation and increased latency. This prohibits such a large model to get deployed on mobile. This motivates the use of tiny models such mobileNet, EfficientNet to get deployed into the devices. But this does not help much in getting better accuracy.

Knowledge distillation is transferring the knowledge of a cumbersome model, which is an ensemble of various…

Neeraj Kumar

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store