This page shows the result of comparative tests among two lenses, the Nikkor 18-70mm ƒ/3.5-4.5G ED DX AF-S and the Sony Zeiss Vario-Tessar T* E 16-70mm F4 ZA OSS. The comparison is not fair, since those lenses belong to different classes (see the conclusion for more details), but this is a specific need of mine as I'm upgrading from the former to the latter, in the context of a migration towards a mirrorless system.
The Nikkor has been, in the past two years, my workhorse for landscape, replacing a number of primes when lightweight and quick operations have a priority over high sharpness — being however a lens with a pretty good sharpness reputation. Actually it enabled me to take more pictures than I would have done, especially during travels. Now, thinking of the mirrorless upgrade, I'd like to replace it with something better — clearly it's unlikely for a zoom to recover the full sharpness of primes, but I'd like to shrink the gap. The Sony Zeiss Vario-Tessar T* E 16-70mm F4 ZA OSS matches the same focals, same aperture and it's indeed the main reason for which I've picked Sony over Fujifilm (the latter, unfortunately, decided to go with a shorter range 18-55mm).
<missing photo of the two lenses>
The Sony Zeiss Vario-Tessar T* E 16-70mm F4 ZA OSS has got some mixed reviews and there is speculation about a high variation in quality of copies and border softness. My first day with it, on the field, seemed to confirm part of the doubts, but now it's high time to a more controlled test. The following is the test procedure:
- a Nikon D5100 was used for the Nikkor lenses, a Sony NEX-6 for the Sony ones — both are 16MP camera bodies;
- both camera bodies were set to manual (M) exposure mode, 1/125 sec @ ƒ/8 (the sweet spot for both lenses), ISO 100, exposed “to the right”;
- the test was repeated for the focal lengths of: 16/18mm, 24mm, 35mm, 50mm, 70mm;
- UV filters were removed from the lenses;
- where applicable, lens stabilisation was disabled;
- at least three shots for each sample were taken and then the best picked over visual inspection;
- a tripod was used as well as the self-timer at 2s to avoid shake (the NEX-6 needed to be re-triggered each time, while the D5100 has been programmed to automatically take three shots in each batch);
- the focusing procedure for the NEX-6 was:
- autofocused at the church (the target);
- shot a sample;
- switched to manual focusing mode and shot another sample; the two samples were later compared to verify that the camera didn't change the focus setting (the NEX-6 is on continuous focus mode and switching to manual mode requires more than a single button pressure);
- while in manual focus mode, the camera was rotated to place the church at the left and then the right border of the frame (always at the vertical middle);
- the focusing procedure for the D5100: similar, but simpler as the separate autofocus lock button in this camera made it possible to easily engage it only when needed;
- the target was 600 meters far from the camera;
- the raw photos were post-processed with the basic steps of my usual workflow in Lightroom 5:
- exposure -1
- contrast -33
- sharpness amount/radius/detail/masking 60/1/60/0
- lens geometric correction and chromatic aberration compensation applied
- photos were cropped to 500 x 500 pixels, converted to sRGB color space and exported as JPEGs at 90% quality.
In the following paragraph pairs of test photo crops can be compared for each focal, in order to compare the IQ of both lenses, both at the centre and the borders, and to roughly evaluate eventual decentering defects. Note that this test is not intended to evaluate the contrast or the colour rendition of any of the two lenses.
Test results
16/18mm
Sony: The right border is just a bit softer than the right one.
Nikkor: The right border is very slightly softer than the right one.
Center: Sony is definitely sharper
Left border: There is no clearly visible sharpness difference.
Right border: Sony is slightly sharper
S1670-16l | S1670-16r |
24mm
Sony: The right border is definitely softer; the left border is quite good.
Nikkor: The right border is definitely softer; the left border is quite good.
Center: Sony is sharper.
Left border: Sony is sharper.
Right border: Sony is slightly sharper, being both lenses definitely soft.
S1670-24l | S1670-24r |
35mm
Sony: The right border is slightly softer: the left border is quite good (actually, it's almost the same quality
of the centre).
Nikkor: The right border is definitely softer; left border is quite good.
Center: Sony is slightly sharper.
Left border: Sony is slightly sharper.
Right border: Sony is sharper.
S1670-35l | S1670-35r |
50mm
Sony: The left border is very slightly softer; both are good.
Nikkor: The right border is softer; the left border is quite good.
Center: Sony is slightly sharper.
Left border: Sony is very slightly sharper.
Right border: Sony is sharper.
S1670-50l | S1670-50r |
70mm
Sony: The left border is softer; the right border is quite good (actually, it's almost the same quality of the
centre).
Nikkor: There's no difference in borders.
Center: Sony is definitely sharper.
Left border: Sony is slightly sharper.
Right border: Sony is definitely sharper.
S1670-70l | S1670-70r |
Conclusion
Summing up the previous findings in a single place, I can try to draw some conclusion on the Sony Zeiss Vario-Tessar T* E 16-70mm F4 ZA OSS border performance:
focal | left border | right border |
16mm | decent | slightly softer |
24mm | quite good | definitely softer |
35mm | quite good | good (slightly softer) |
50mm | good (very slightly softer) | good |
70mm | softer | quite good |
With respect to my previous tests, this round went better: it looks as shooting from a tripod gives substantially better results for the borders in comparison to hand-held with the lens stabilisation turned on. I don't know whether relevant, but in this session the target was decisively farther (600m) than in the previous sessions.
Anyway, my previous findings, both hand-held and with the tripod, are confirmed: there's a slight decentering at the right side for the shorter focals, which becomes just barely visible at 50mm and then moves to the right side for the longest focal. There's a definitely weak point at the right border @24mm, which confirms a previous test session on the tripod (not published here).
The Nikkor lens shows a substantially similar, perhaps slightly worse decentering behaviour (to be honest, this lens is not brand new, but has got almost two years of operating life). Looking at the raw files, there's evident chromatic aberration at the borders at both ends (not at 35mm), while it is almost not visible with the Sony lens; it can be compensated in Lightroom, but it contributes in degrading the final visual sharpness. Below there are some further photo pairs to compare (the right borders from all the focals) where neither geometric correction nor chromatic aberration was compensated (no sharpness applied in post-production here).
S1670-16r-raw | N1870-18r-raw |
In any case, at all focals, both at the centre and the borders, the Sony lens performed better than the Nikkor, sometimes slightly, more often in a substantial way. Therefore I can declare that, in this test session, the Sony Zeiss Vario-Tessar T* E 16-70mm F4 ZA OSS is the winner on the Nikkor 18-70mm ƒ/3.5-4.5G ED DX AF-S; so my new lens is a clear improvement from the optical point of view, in addition to the fact that it's lighter and features image stabilisation. This is not the final test, anyway: more will come in different conditions.
I have to recall that the price tag of the Sony Zeiss is 4/5 times the one of the Nikkor lens, so the result of the match shouldn't be a surprise — I can say that, considering the alleged variation of samples of the Sony lens, I've not got a too bad copy (even though I expected an overall better quality in the sense of a more evenly quality of borders at 70mm and especially 24mm). A fairer match should compare against e.g. the Nikkor 16-85mm ƒ/3.5-5.6G ED VR AF-S DX, which is known to be quite better than my 18-70mm. I could speculate that there would not be much difference between the Sony Zeiss and the Nikkor in this case — the latter, again, being quite cheaper (half the price). Even considering that mirrorless systems are more expensive, given their youth, and that the Nikkor 16-85mm is not a constant-aperture lens, I think it's fair to conclude that the Sony Zeiss Vario-Tessar T* E 16-70mm F4 ZA OSS is substantially overpriced.