Add support for Llama2, Palm, Cohere, Anthropic, Replicate Models - using litellm

[ishaan-jaff]

This PR adds support for models from all the above mentioned providers using https://github.com/BerriAI/litellm/

ChatLiteLLM() is integrated into langchain and allows you to call all models using the OpenAI I/O interface
https://python.langchain.com/docs/integrations/chat/litellm

Here's an example of how to use ChatLiteLLM()

ChatLiteLLM(model="gpt-3.5-turbo")
ChatLiteLLM(model="claude-2", temperature=0.3)
ChatLiteLLM(model="command-nightly")
ChatLiteLLM(model="replicate/llama-2-70b-chat:2c1608e18606fad2812020dc541930f2d0495ce32eee50074220b87300bc16e1")

[ishaan-jaff]

@Vasilije1990 can you please take a look at this PR?

Happy to use docs/tests if this initial commit looks good

[Vasilije1990]

@Vasilije1990 can you please take a look at this PR?

Happy to use docs/tests if this initial commit looks good

Hi,

Are you going around replacing the Langchain setup with yours on people repos?