Li6.3La3Zr1.65W0.35O12 (LLZO)-Li6PS5Cl (LPSC) composite electrolytes and all-solid-state cells containing LLZO-LPSC were fabricated by cold pressing at room temperature. The LPSC:LLZO ratio was varied, and the microstructure, ionic conductivity, and electrochemical performance of the corresponding composite electrolytes were investigated; the ionic conductivity of the composite electrolytes was three or four orders of magnitude higher than that of LLZO. The high conductivity of the composite electrolytes was attributed to the enhanced relative density and the rule of mixture for soft LPSC particles with high lithium-ion conductivity (~10−4 S·cm−1). The specific capacities of all-solid-state cells (ASSCs) consisting of a LiNi0.8Co0.1Mn0.1O2 (NCM811) cathode and the composite electrolytes of LLZO:LPSC = 7:3 and 6:4 were 163 and 167 mAh·g−1, respectively, at 0.1 C and room temperature. Moreover, the charge–discharge curves of the ASSCs with the composite electrolytes revealed that a good interfacial contact was successfully formed between the NCM811 cathode and the LLZO-LPSC composite electrolyte.