There are two problems you report. One is the excessive screen brightness even at the lowest level that your settings allow. The next is that you want to reduce the battery consumption due to this higher brightness.
If you want the first one but not worried about the second you can try screen filter apps. These will reduce the brightness as perceived by our eyes, but will not do any battery saving stuff. Please look at the apps similar to Screen Filter
On the other hand if you want power saving as well then probably you should have a rooted device that will allow the apps like Velis Auto Brightness to work.