Don't be embarrassed, we have all started somewhere. Also if we see your space and what you now have perhaps our advice when you ask a question will be different. Not all of us are in the same phase of knowledge about the Japanese Garden nor do we have gardens that are totally true Japanese Gardens. I too am slowly adding more of a Japanese feel to a perennial flower garden that borders my Japanese Garden. But I am not ready to give up the joy my flowers give me, so some views through my garden will include my flowers and others may frown on that, but I am not offended. These spaces are our private sanctuaries and if you choose to only pay homage to a small area as a Japanese Garden then I respect your personal choice and I am sure others on our forum would agree.
And don't forget, small spaces are perfect for a Japanese Garden, so don't be shy.
Welcome to the forum.