Solution:
Update your NuGet Package Manager extension. Go to
Tools->Extensions and Updates and selectUpdates->Visual Studio Gallery. Update the NuGet Package Manager extension. Then try to install the package after Visual Studio gets restarted.