This Work Addresses the Question of the Efficient Numerical Solution of Time-Domain Boundary Integral Equations With Retarded Potentials Arising In the Problems of Acoustic and Electromagnetic Scattering. the Convolutional Form of the Time-Domain Boundary Operators Allows to Discretize Them With the Help of Runge-Kutta Convolution Quadrature. In the Work It Is Shown How This Property Can Be Used In the Recursive Algorithm to Construct Only a Few Matrices With the Near-Field, While For the Rest of the Matrices the Far-Field Only Is Assembled. the Resulting Method Allows to Solve the Three-Dimensional Wave Scattering Problem With Asymptotically Almost Linear Complexity. the Efficiency of the Approach Is Confirmed By Extensive Numerical Experiments.