Malaysia is the second largest palm oil producer and exporter globally. When crude palm oil is produced in both plantations and oil processing mills, a large amount of oil palm empty fruit bunch (OPEFB) is simultaneously produced as a waste product. Here, we describe the preparation of hydrolysate from OPEFB. After OPEFB was hydrothermally treated at 180–200 °C, the resultant liquid phase was subjected to high-performance liquid chromatography analysis, while the solid phase was used for acidic and enzymatic hydrolysis. Hemicellulose yield from the acid-treated solid phase decreased from 153 mg/g-OPEFB to 27.5 mg/g-OPEFB by increasing the hydrothermal treatment temperature from 180 to 200 °C. Glucose yield from the enzyme-treated solid phase obtained after hydrothermal treatment at 200 °C was the highest (234 ± 1.90 mg/g-OPEFB, 61.7% production efficiency). In contrast, xylose, mannose, galactose, and arabinose yields in the hydrolysate prepared from the solid phase hydrothermally treated at 200 °C were the lowest. Thus, we concluded that the optimum temperature for hydrothermal pretreatment was 200 °C, which was caused by the low hemicellulose yield. Based on these results, we have established an effective method for preparing OPEFB hydrolysates with high glucose content.