If yum whatprovides /path/to/file
is slow for you, try a faster alternative:
rpm -q --whatprovides /path/to/file
For example:
$ rpm -q --whatprovides /usr/bin/clibrary
speech-dispatcher-0.7.1-5.fc15.x86_64
rpm is quite fast and yum is too slow. Get back to basics!