Monodisperse, nonmagnetic, asymmetrical composite dumbbells in a suspension of magnetic nanoparticles (ferrofluid) were aligned by application of an external magnetic field to the ferrofluid. The asymmetrical composite dumbbells were prepared by two-step soap-free emulsion polymerization consisting of the first polymerization to coat spherical silica cores with cross-linked poly(methyl methacrylate) (PMMA) shell and the second polymerization to protrude a polystyrene (PSt) lobe from the core shell particles. A chain structure of nonmagnetic dumbbells oriented to the applied magnetic field was observed at nanoparticle content of 2.0 vol % and field strengths higher than 1.0 mT. A similar chain structure of the dumbbells was observed under application of alternating electric field at strengths higher than 50 V/mm. Parallel and orthogonally combined applications of the electric and magnetic fields were also conducted to examine independence of the electric and magnetic applications as operational factors in the dumbbell assembling. Dumbbell chains stiffer than those in a single application of external field were formed in the parallel combined application of electric and magnetic fields. The orthogonal combination of the different applied fields could form a magnetically aligned chain structure of the nonmagnetic dumbbells oriented to the electric field. The present work experimentally indicated that the employment of inverse magnetorheological effect for nonmagnetic, anisotropic particles can be a useful method for the simultaneous controls over the orientation and the positon of anisotropic particles in their assembling.