The aim of this work is to develop a dislocation density based model for IF and DP steels that incorporates details of the microstructure evolution at the grain-size scale. The model takes into account (i) the contribution of the chemical composition for the prediction of the initial yield stress, (ii) the description of initial texture anisotropy by incorporating grain-size dependent anisotropy coefficients in Hill'48 yield criterion, (iii) the contribution of three dislocation density “families” that are associated with forward, reverse and latent structures. It reproduces the macroscopic transient behaviors observed when strain-path changes occur. The model is implemented in FE code in order to assess its predictive capabilities in case of industrial applications.