%0 Journal Article %T On Certain Limitations of Recursive Representation Model %A Jastrzębski, Stanisław %A Sieradzki, Igor %J Schedae Informaticae %V 2016 %R 10.4467/20838476SI.16.003.6184 %N Volume 25 %P 37-47 %K support vector machines, random recursive support vector machine, extreme learning machine, representation learning, stacked generalization %@ 1732-3916 %D 2017 %U https://ejournals.eu/en/journal/schedae-informaticae/article/on-certain-limitations-of-recursive-representation-model %X There is a strong research eort towards developing models that can achieve state-of-the-art results without sacrificing interpretability and simplicity. One of such is recently proposed Recursive Random Support Vector Machine (R2SVM) model, which is composed of stacked linear models. R2SVM was reported to learn deep representations outperforming many strong classiffiers like Deep Convolutional Neural Network. In this paper we try to analyze it both from theoretical and empirical perspective and show its important limitations.Analysis of similar model Deep Representation Extreme Learning Machine (DrELM) is also included. It is concluded that models in its current form achieves lower accuracy scores than Support Vector Machine with Radial Basis Function kernel.