We present detailed studies on exciton-photon coupling and polariton emission based on a poly(1,4-phenylenevinylene) copolymer, Super Yellow (SY), in a series of optical microcavities and optoelectronic devices, including light-emitting diode (LED) and light-emitting transistor (LET). We show that sufficiently thick SY microcavities can generate ultrastrong coupling with Rabi splitting energies exceeding 1 eV and exhibit spectrally narrow, nearly angle-independent photoluminescence following lower polariton (LP) mode dispersion. When the microcavity is designed with a matched LP low-energy state and exciton emission peak for radiative pumping, the conversion efficiency from exciton to polariton emission can reach up to 80%. By introducing appropriate injection layers in a SY microcavity and optimizing the cavity design, we further demonstrate a high-performance ultrastrongly coupled SY LED with weakly dispersive electroluminescence along LP mode and a maximum external quantum efficiency (EQE) of 2.8%. Finally, we realize an ultrastrongly coupled LET based on vertical integration of a high-mobility ZnO transistor and a SY LED in a microcavity, which enables a large switching ratio, uniform emission in the ZnO pattern, and LP mode emission with a maximum EQE of 2.4%. This vertical LET addresses the difficulty of achieving high emission performance and well-defined emission areas in typical planar LETs, and opens up the possibility of applying various strongly coupled emitters for advanced polariton devices and high-resolution applications.