Nonlinear derivatives mainly refer to the complex nonlinear relationship between the price of the derivative instrument and the price of the underlying asset. For example, the options you mentioned, as well as exotic derivative securities, etc. all belong to this type; the opposite is Linear derivatives include forwards, futures, swaps, etc., that is, their price has a linear relationship with the price of the underlying asset.
Hope it's useful to you!