Enhancing Black-box LLM with Small Models