We argue that a class of three-dimensional conformal field theories that arise as IR fixed points of N=4 QED have a Lagrangian description in terms of Chern-Simons-matter theories. In the two-flavor case, the 3D mirror symmetry which exchanges the Coulomb and Higgs branches of the theory, is manifest in the Chern-Simons-matter description.