download dataset

너무 멀리 가는중인듯..어떻하지?

kaggle 사용하기

일단 가입한다. https://www.kaggle.com/

kaggle api key 발급

Alt text

Alt text

setting >> api >> create new api token

Alt text

kaggle.json이 다운로드 된다.,

Alt text

이제 kaggle.json을 ~/.kaggle/로 옮긴다.

mkdir ~/.kaggle
mv ~/Downloads/kaggle.json ~/.kaggle/
chmod 600 ~/.kaggle/kaggle.json

kaggle cli 설치

pip install kaggle

model download

원하는 모델페이지에 가서 download를 누르자.

https://www.kaggle.com/c/dogs-vs-cats-redux-kernels-edition

Alt text

data 탭을 누르자.

여기에서 다음부분을 복사한다.

Alt text

kaggle competitions download -c dogs-vs-cats-redux-kernels-edition

docker로 kaggle cli 실행

FROM python:3.10-bullseye

WORKDIR /code

COPY ./requirements.txt ./

RUN pip install --upgrade pip

RUN pip install -r requirements.txt

WORKDIR /code/src

CMD [ "python", "app.py" ]

# docker-compose.yml
version: '3.10'
services:
  python:
    build: .
    container_name: python
    volumes:
      - ./src:/code/src
      - ./.kaggle:/root/.kaggle
    command: ["sleep", "infinity"]

requirements.txt

tensorflow
pandas
matplotlib
kaggle

.kaggle 폴더에 kaggle.json이 있어야 한다.

docker-compose up -d --build
docker exec -it python sh

kaggle competitions list -h
kaggle competitions download -h

kaggle competitions download -c dogs-vs-cats-redux-kernels-edition