Overview
This is a repackaged open-source software product wherein additional charges apply for technical support and maintenance by Apps4Rent. Utilize the capabilities of Llama2-7B, PromptBench and Gradio on this GPU-powered machine. Llama 2 is an open-source project. This means Meta is publishing the entire model so anyone can use it to build new models or applications. Llama 2 is a large language model which has been trained on a vast dataset of publicly available internet data, enjoying the advantage of a dataset both more recent and more diverse.
PromptBench is a Pytorch-based Python package for Evaluation of Large Language Models (LLMs). It provides user-friendly APIs for researchers to conduct evaluation on LLMs.
Gradio is the fastest way to demo your machine learning model with a friendly web interface so that anyone can use it, anywhere. Gradio allows you to build demos and share them, all in Python. And usually in just a few lines of code.
Disclaimer: The respective trademarks mentioned in the offering are owned by the respective companies. We do not provide the commercial license of any of these products. Many of the products have a free, demo or Open-Source license as applicable. Image may take up to 5-7 minutes for initial launch.
Highlights
- Apps4Rent provides Llama2-7B, PromptBench and Gradio with GPU enabled machine which is ready to use for Production Environment.
- Take advantage of Llama2-7B, PromptBench and Gradio's combined power on this GPU enabled machine to achieve your task. Apps4Rent is offering "Pack of 3 product" (3 software's on a single machine) at an affordable price point of USD 0.1/hour (any vCPU).
Details
Typical total price
$1.00/hour
Pricing
- ...
Instance type | Product cost/hour | EC2 cost/hour | Total/hour |
|---|---|---|---|
t1.micro | $0.10 | $0.02 | $0.12 |
t2.nano | $0.10 | $0.006 | $0.106 |
t2.micro AWS Free Tier | $0.10 | $0.012 | $0.112 |
t2.small | $0.10 | $0.023 | $0.123 |
t2.medium | $0.10 | $0.046 | $0.146 |
t2.large | $0.10 | $0.093 | $0.193 |
t3.nano | $0.10 | $0.005 | $0.105 |
t3.micro AWS Free Tier | $0.10 | $0.01 | $0.11 |
t3.small | $0.10 | $0.021 | $0.121 |
t3.medium | $0.10 | $0.042 | $0.142 |
Additional AWS infrastructure costs
Type | Cost |
|---|---|
EBS General Purpose SSD (gp2) volumes | $0.10/per GB/month of provisioned storage |
Vendor refund policy
Apps4Rent does not offer commercial licenses of any of the products mentioned above. The products come with open-source licenses.
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Gradio release note: https://github.com/gradio-app/gradio/releases
Git release notes: https://docs.github.com/en/repositories/releasing-projects-on-github/automatically-generated-release-notes
PromptBench release notes: https://arxiv.org/abs/2312.07910
Additional details
Usage instructions
*For Linux: Connect to your Linux instance via port no. 22 using SSH. *Please refer this article: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/AccessingInstancesLinux.html *Sign-in credentials: Username: ubuntu
*Verifying Installed tools: Llama2-7B: Update machine: sudo apt-get update Become superuser: sudo su Navigate to directory: cd llama List files: ls Include hidden files: ls -la
PromptBench: Update machine: sudo apt-get update Navigate to directory: cd promptbench List files: ls Include hidden files: ls -la
Checking Dependencies: Git version: git --version (expect output: 2.25.1) Python version: python3 --version (expect output: 3.8.10)
Gradio: Update instance: sudo apt-get update Activate virtual environment: source my-env/bin/activate Check Gradio details: pip show gradio Exit virtual environment: deactivate *Below are the minimum external resources subscriber needs to have to use this product: i) An Internet Connection is required for this product to function as expected. ii)We recommend keeping your crucial data in a custom made encrypted EBS to save it from termination in future.
Support
Vendor support
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.
Similar products
