This paper proposes a novel adaptive observer for Lipschitz nonlinear systems and dissipative nonlinear systems in the presence of disturbances and sensor noise. The observer is based on an H infinity observer that can estimate both the system states and unknown parameters by minimising a cost function consisting of the sum of the square integrals of the estimation errors in the states and unknown parameters. The paper presents necessary and sufficient conditions for the existence of the observer, and the equations for determining observer gains are formulated as linear matrix inequalities (LMIs) that can be solved offline using commercially available LMI solvers. The observer design has also been extended to the case of time-varying unknown parameters. The use of the observer is demonstrated through illustrative examples and the performance is compared with extended Kalman filtering. Compared to previous results on nonlinear observers, the proposed observer is more computationally efficient, and guarantees state and parameter estimation for two very broad classes of nonlinear systems (Lipschitz and dissipative nonlinear systems) in the presence of input disturbances and sensor noise. In addition, the proposed observer does not require online computation of the observer gain.