This data set comprises images of bulk material of brick and sand-lime brick on a conveyor belt. The images were recorded on the small-scale optical belt sorter Tablesort. A thorough description of the system can be found in Georg Maier, Florian Pfaff, Christoph Pieper, Robin Gruna, Benjamin Noack, Harald Kruggel-Emden,Thomas Längle, Uwe D. Hanebeck, Jürgen Beyerer, Experimental Evaluation of a Novel Sensor-Based Sorting Approach Featuring Predictive Real-Time Multiobject Tracking,Transactions on Industrial Electronics, February 2020. See also the project website. This dataset is part of a batch of recordings of construction and demolition waste consisting of brick and sand-lime brick on optical sorters. Please use the search function with the keywords "Images of Construction and Demolition Waste" (in quotes) to find them. The data set was recorded with a Bonito CL-400C. Please see the debayer script on GitHub https://github.com/geomai/debayer_bonito. The frame rate is approximately 192 Hz. To this date, publications that used this data include Marcel Reith-Braun, Albert Bauer, Maximilian Staab, Florian Pfaff, Georg Maier, Robin Gruna, Thomas Längle, Jürgen Beyerer, Harald Kruggel-Emden and Uwe D. Hanebeck, GridSort: Image-based Optical Bulk Material Sorting Using Convolutional LSTMs, 22nd IFAC World Congress, Yokohama, Japan, July 2023. Acknowledgment The IGF project 20354 N of the research association Forschungs-Gesellschaft Verfahrens-Technik e.V. (GVT) was supported via the AiF in a program to promote the Industrial Community Research and Development (IGF) by the Federal Ministry for Economic Affairs and Climate Action on the basis of a resolution of the German Bundestag.