You can add the dimensions of your door/window or newly created wall objects with the "Add/Remove Dimension Parent" feature in the right click menu to the dimensions you create with the inner dimension command, and you can remove the dimensions of the objects you do not want.
To add door/window dimensions;
Select the dimension you want to add and click the right mouse button.
When you click the "Add/Remove Dimension Parent" line from the drop down list, the dimensioned objects will change color.
Select the windows you want to add to the dimension and click the right mouse button.
The windows you choose have been added to your inner dimension .