We present detailed, low temperature, magnetoresistance and specific heat data of single crystal YbNiSi3 measured in magnetic field applied along the easy magnetic axis, H || b. An initially antiferromagnetic ground state changes into a field-induced metamagnetic phase at ~16 kOe (T -> 0). On further increase of magnetic field, magnetic order is suppressed at ~85 kOe. The functional behaviors of the resistivity and specific heat are discussed in comparison with those of the few other stoichiometric, heavy fermion compounds with established field-induced quantum critical point.