We propose the Starobinsky-type inflationary model in the matter-coupled $N=1$ four-dimensional supergravity with the massive vector multiplet that has inflaton (scalaron) and goldstino amongst its field components, whose action includes the Dirac-Born-Infeld-type kinetic term and the generalized (new) Fayet-Iliopoulos-type term, without gauging the R-symmetry. The $N=1$ chiral matter (hidden sector) is described by the modified Polonyi model needed for spontaneous supersymmetry breaking after inflation. We compute the bosonic action and the scalar potential of the model, and show that it can accommodate the positive (observed) cosmological constant (as the dark energy) and the spontaneous supersymmetry breaking at high scale after the Starobinsky inflation.