New recursive least squares algorithms with rank two updates (RLSR2) that include both exponential and instantaneous forgetting (implemented via a proper choice of the forgetting factor and the window size) are introduced and systematically associated in this report with well-known RLS algorithms with rank one updates. Moreover, new properties (which can be used for further performance improvement) of the recursive algorithms associated with the convergence of the inverse of information matrix a...