Fair Use isn't the issue (it's a defense in certain circumstances, but not a right). If you legally enter a binding contract, its provisions apply to you and limit your freedom of action. If you take some positive action in relation to a software license, you may be judged to have agreed to it and therefore it applies to what you can do (although there are limits to what it can require). Fair Use won't save you there.
Oracle is well-known to prohibit independent benchmarks in its contracts.