Download as PDF, PPTX
![Database Instance
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
db = mc['madrid_pug']
!
#or
!
db = mc.madrid_pug
database
instance](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-21-320.jpg)
![Collection Instance
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc[‘madrid_pug’]['testcollection']
!
#or
!
coll = mc.madrid_pug.testcollection
collection
instance](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-22-320.jpg)
![Insert
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
coll.insert( {'field_one': 'some value'})](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-26-320.jpg)
![Find
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
cur = coll.find_one( {'field_one': 'some value'})
!
for d in cur:
print d](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-27-320.jpg)
![Update
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
result = coll.update_one( {'field_one': 'some value'},
{"$set": {'field_one': 'new_value'}} )
#or
!
result = coll.update_many( {'field_one': 'some value'},
{"$set": {'field_one': 'new_value'}} )
!
print(result)
!](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-28-320.jpg)
![Remove
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
result = coll.delete_one( {'field_one': 'some value’})
!
#or
!
result = coll.delete_many( {'field_one': 'some value'})
!
print(result)
!](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-29-320.jpg)
![Aggregation Framework
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
cur = coll.aggregate( [
{"$match": {'field_one': {"$exists": True }}} ,
{"$project": { "new_label": "$field_one" }} ]
)
!
for d in cur:
print(d)](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-32-320.jpg)
![GridFS
#!/bin/python
from
pymongo
import
MongoClient
import
gridfs
!
!
mc
=
MongoClient()
database
=
mc.grid_example
!
!
gfs
=
gridfs.GridFS(
database)
!
read_file
=
open(
'/tmp/somefile',
'r')
!
gfs.put(read_file,
author='Norberto',
tags=['awesome',
'madrid',
'pug'])
call
grids
lib
w/
database](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-35-320.jpg)
![GridFS
#!/bin/python
from
pymongo
import
MongoClient
import
gridfs
!
!
mc
=
MongoClient()
database
=
mc.grid_example
!
!
gfs
=
gridfs.GridFS(
database)
!
read_file
=
open(
'/tmp/somefile',
'r')
!
gfs.put(read_file,
author='Norberto',
tags=['awesome',
'madrid',
'pug'])
open
file
for
reading](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-36-320.jpg)
![GridFS
#!/bin/python
from
pymongo
import
MongoClient
import
gridfs
!
!
mc
=
MongoClient()
database
=
mc.grid_example
!
!
gfs
=
gridfs.GridFS(
database)
!
read_file
=
open(
'/tmp/somefile',
'r')
!
gfs.put(read_file,
author='Norberto',
tags=['awesome',
'madrid',
'pug'])
call
put
to
store
file
and
metadata](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-37-320.jpg)
![Compound Field Index
from pymongo import ASCENDING, DESCENDING, MongoClient
mc = MongoClient()
!
coll = mc.madrid_pug.testcollection
!
coll.ensure_index( [('field_ascending', ASCENDING),
('field_descending', DESCENDING)] )
indexed
fields indexing
order](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-44-320.jpg)
![Multikey Field Index
mc = MongoClient()
!
coll = mc.madrid_pug.testcollection
!
!
coll.insert( {'array_field': [1, 2, 54, 89]})
!
coll.ensure_index( 'array_field')
indexed
field](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-45-320.jpg)
![Geospatial Field Index
from pymongo import GEOSPHERE
import geojson
!
!
p = geojson.Point( [-73.9858603477478, 40.75929362758241])
!
coll.insert( {'point', p)
!
coll.ensure_index( [( 'point', GEOSPHERE )])
index
type](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/85/Python-and-MongoDB-46-320.jpg)
![Database Instance
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
db = mc['madrid_pug']
!
#or
!
db = mc.madrid_pug
database
instance](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-21-2048.jpg)
![Collection Instance
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc[‘madrid_pug’]['testcollection']
!
#or
!
coll = mc.madrid_pug.testcollection
collection
instance](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-22-2048.jpg)
![Insert
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
coll.insert( {'field_one': 'some value'})](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-26-2048.jpg)
![Find
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
cur = coll.find_one( {'field_one': 'some value'})
!
for d in cur:
print d](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-27-2048.jpg)
![Update
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
result = coll.update_one( {'field_one': 'some value'},
{"$set": {'field_one': 'new_value'}} )
#or
!
result = coll.update_many( {'field_one': 'some value'},
{"$set": {'field_one': 'new_value'}} )
!
print(result)
!](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-28-2048.jpg)
![Remove
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
result = coll.delete_one( {'field_one': 'some value’})
!
#or
!
result = coll.delete_many( {'field_one': 'some value'})
!
print(result)
!](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-29-2048.jpg)
![Aggregation Framework
#!/bin/python
from pymongo import MongoClient
mc = MongoClient()
!
coll = mc['madrid_pug']['testcollection']
!
!
cur = coll.aggregate( [
{"$match": {'field_one': {"$exists": True }}} ,
{"$project": { "new_label": "$field_one" }} ]
)
!
for d in cur:
print(d)](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-32-2048.jpg)
![GridFS
#!/bin/python
from
pymongo
import
MongoClient
import
gridfs
!
!
mc
=
MongoClient()
database
=
mc.grid_example
!
!
gfs
=
gridfs.GridFS(
database)
!
read_file
=
open(
'/tmp/somefile',
'r')
!
gfs.put(read_file,
author='Norberto',
tags=['awesome',
'madrid',
'pug'])
call
grids
lib
w/
database](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-35-2048.jpg)
![GridFS
#!/bin/python
from
pymongo
import
MongoClient
import
gridfs
!
!
mc
=
MongoClient()
database
=
mc.grid_example
!
!
gfs
=
gridfs.GridFS(
database)
!
read_file
=
open(
'/tmp/somefile',
'r')
!
gfs.put(read_file,
author='Norberto',
tags=['awesome',
'madrid',
'pug'])
open
file
for
reading](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-36-2048.jpg)
![GridFS
#!/bin/python
from
pymongo
import
MongoClient
import
gridfs
!
!
mc
=
MongoClient()
database
=
mc.grid_example
!
!
gfs
=
gridfs.GridFS(
database)
!
read_file
=
open(
'/tmp/somefile',
'r')
!
gfs.put(read_file,
author='Norberto',
tags=['awesome',
'madrid',
'pug'])
call
put
to
store
file
and
metadata](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-37-2048.jpg)
![Compound Field Index
from pymongo import ASCENDING, DESCENDING, MongoClient
mc = MongoClient()
!
coll = mc.madrid_pug.testcollection
!
coll.ensure_index( [('field_ascending', ASCENDING),
('field_descending', DESCENDING)] )
indexed
fields indexing
order](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-44-2048.jpg)
![Multikey Field Index
mc = MongoClient()
!
coll = mc.madrid_pug.testcollection
!
!
coll.insert( {'array_field': [1, 2, 54, 89]})
!
coll.ensure_index( 'array_field')
indexed
field](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-45-2048.jpg)
![Geospatial Field Index
from pymongo import GEOSPHERE
import geojson
!
!
p = geojson.Point( [-73.9858603477478, 40.75929362758241])
!
coll.insert( {'point', p)
!
coll.ensure_index( [( 'point', GEOSPHERE )])
index
type](https://image.slidesharecdn.com/madridpug-150709181856-lva1-app6892/75/Python-and-MongoDB-46-2048.jpg)
Uploaded byNorberto Leite
Python and MongoDB
This document provides an overview of using MongoDB with Python. It introduces pymongo, the official Python driver for MongoDB, and covers connecting to MongoDB, performing CRUD operations, aggregation, GridFS for large files, indexing, and ODM frameworks. The presenter is Norberto Leite, a MongoDB Technical Evangelist based in Madrid, Spain.
More Related Content
Python and MongoDB
- 2. MongoDB + Python NorbertoLeite Technical Evangelist norberto@mongodb.com
- 3.
- 4. Ola, I'm Norberto NorbertoLeite Technical Evangelist ! Madrid, Spain @nleite norberto@mongodb.com http://www.mongodb.com/norberto
- 6.
- 7. MongoDB GENERAL PURPOSE DOCUMENTDATABASE OPEN-SOURCE
- 8.
- 9. MongoDB Features JSON DocumentModel with Dynamic Schemas Auto-Sharding for Horizontal Scalability Text Search Aggregation Framework and MapReduce Full, Flexible Index Support and Rich Queries Built-In Replication for High Availability Advanced Security Large Media Storage with GridFS
- 10. MongoDB Inc. 400+ employees2,000+ customers Over $311 million in funding13 offices around the world
- 11. THE LARGEST ECOSYSTEM 9,000,000+ MongoDBDownloads 250,000+ Online Education Registrants 35,000+ MongoDB User Group Members 35,000+ MongoDB Management Service (MMS) Users 750+ Technology and Services Partners 2,000+ Customers Across All Industries
- 12.
- 13. pymongo • MongoDB Pythonofficial driver • Rockstart developer team • Jesse Jiryu Davis, Bernie Hackett • One of oldest and better maintained drivers • Python and MongoDB are a natural fit • BSON is very similar to dictionaries • (everyone likes dictionaries) • http://api.mongodb.org/python/current/ • https://github.com/mongodb/mongo-python-driver
- 14. pymongo 3.0 ! • Serverdiscovery spec • Monitoring spec • Faster client startup when connecting to Replica Set • Faster failover • More robust replica set connections • API clean up
- 15.
- 16. Connecting #!/bin/python from pymongo importMongoClient ! mc = MongoClient() client instance
- 17. Connecting #!/bin/python from pymongo importMongoClient ! uri = 'mongodb://127.0.0.1' mc = MongoClient(uri)
- 18. Connecting #!/bin/python from pymongo importMongoClient ! uri = 'mongodb://127.0.0.1' mc = MongoClient(host=uri, max_pool_size=10)
- 19. Connecting to ReplicaSet #!/bin/python from pymongo import MongoClient ! uri = ‘mongodb://127.0.0.1?replicaSet=MYREPLICA' mc = MongoClient(uri)
- 20. Connecting to ReplicaSet #!/bin/python from pymongo import MongoClient ! uri = ‘mongodb://127.0.0.1' mc = MongoClient(host=uri, replicaSet='MYREPLICA')
- 21. Database Instance #!/bin/python from pymongoimport MongoClient mc = MongoClient() ! db = mc['madrid_pug'] ! #or ! db = mc.madrid_pug database instance
- 22. Collection Instance #!/bin/python from pymongoimport MongoClient mc = MongoClient() ! coll = mc[‘madrid_pug’]['testcollection'] ! #or ! coll = mc.madrid_pug.testcollection collection instance
- 23.
- 24. Operations • Insert • Remove •Update • Query • Aggregate • Create Indexes • …
- 25. CRUD • Insert • Remove •Update • Query • Aggregate • Create Indexes • …
- 26. Insert #!/bin/python from pymongo importMongoClient mc = MongoClient() ! coll = mc['madrid_pug']['testcollection'] ! ! coll.insert( {'field_one': 'some value'})
- 27. Find #!/bin/python from pymongo importMongoClient mc = MongoClient() ! coll = mc['madrid_pug']['testcollection'] ! ! cur = coll.find_one( {'field_one': 'some value'}) ! for d in cur: print d
- 28. Update #!/bin/python from pymongo importMongoClient mc = MongoClient() ! coll = mc['madrid_pug']['testcollection'] ! ! result = coll.update_one( {'field_one': 'some value'}, {"$set": {'field_one': 'new_value'}} ) #or ! result = coll.update_many( {'field_one': 'some value'}, {"$set": {'field_one': 'new_value'}} ) ! print(result) !
- 29. Remove #!/bin/python from pymongo importMongoClient mc = MongoClient() ! coll = mc['madrid_pug']['testcollection'] ! ! result = coll.delete_one( {'field_one': 'some value’}) ! #or ! result = coll.delete_many( {'field_one': 'some value'}) ! print(result) !
- 30.
- 31. Aggregation Framework • Analyticalworkload solution • Pipeline processing • Several Stages • $match • $group • $project • $unwind • $sort • $limit • $skip • $out ! • http://docs.mongodb.org/manual/aggregation/
- 32. Aggregation Framework #!/bin/python from pymongoimport MongoClient mc = MongoClient() ! coll = mc['madrid_pug']['testcollection'] ! ! cur = coll.aggregate( [ {"$match": {'field_one': {"$exists": True }}} , {"$project": { "new_label": "$field_one" }} ] ) ! for d in cur: print(d)
- 33.
- 34. GridFS • MongoDB hasa 16MB document size limit • So how can we store data bigger than 16MB? • Media files (images, pdf’s, long binary files …) • GridFS • Convention more than a feature • All drivers implement this convention • pymongo is no different • Very flexible approach • Handy out-of-the-box solution
- 35. GridFS #!/bin/python from pymongo import MongoClient import gridfs ! ! mc = MongoClient() database = mc.grid_example ! ! gfs = gridfs.GridFS( database) ! read_file = open( '/tmp/somefile', 'r') ! gfs.put(read_file, author='Norberto', tags=['awesome', 'madrid', 'pug']) call grids lib w/ database
- 36. GridFS #!/bin/python from pymongo import MongoClient import gridfs ! ! mc = MongoClient() database = mc.grid_example ! ! gfs = gridfs.GridFS( database) ! read_file = open( '/tmp/somefile', 'r') ! gfs.put(read_file, author='Norberto', tags=['awesome', 'madrid', 'pug']) open file for reading
- 37. GridFS #!/bin/python from pymongo import MongoClient import gridfs ! ! mc = MongoClient() database = mc.grid_example ! ! gfs = gridfs.GridFS( database) ! read_file = open( '/tmp/somefile', 'r') ! gfs.put(read_file, author='Norberto', tags=['awesome', 'madrid', 'pug']) call put to store file and metadata
- 38. GridFS mongo nair(mongod-‐3.1.0-‐pre-‐) grid_sample> show dbs grid_sample 0.246GB local 0.000GB nair(mongod-‐3.1.0-‐pre-‐) grid_sample> show collections fs.chunks 258.995MB / 252.070MB fs.files 0.000MB / 0.016MB database created
- 39. GridFS mongo nair(mongod-‐3.1.0-‐pre-‐) grid_sample> show dbs grid_sample 0.246GB local 0.000GB nair(mongod-‐3.1.0-‐pre-‐) grid_sample> show collections fs.chunks 258.995MB / 252.070MB fs.files 0.000MB / 0.016MB 2 collections
- 40. GridFS mongo nair(mongod-‐3.1.0-‐pre-‐) grid_sample> show dbs grid_sample 0.246GB local 0.000GB nair(mongod-‐3.1.0-‐pre-‐) grid_sample> show collections fs.chunks 258.995MB / 252.070MB fs.files 0.000MB / 0.016MB chunks collection holds binary data files holds metada data
- 41.
- 42. Indexes • Single Field •Compound • Multikey • Geospatial • 2d • 2dSphere - GeoJSON • Full Text • Hash Based • TTL indexes • Unique • Sparse
- 43. Single Field Index frompymongo import ASCENDING, MongoClient mc = MongoClient() ! coll = mc.madrid_pug.testcollection ! coll.ensure_index( 'some_single_field', ASCENDING ) indexed field indexing order
- 44. Compound Field Index frompymongo import ASCENDING, DESCENDING, MongoClient mc = MongoClient() ! coll = mc.madrid_pug.testcollection ! coll.ensure_index( [('field_ascending', ASCENDING), ('field_descending', DESCENDING)] ) indexed fields indexing order
- 45. Multikey Field Index mc= MongoClient() ! coll = mc.madrid_pug.testcollection ! ! coll.insert( {'array_field': [1, 2, 54, 89]}) ! coll.ensure_index( 'array_field') indexed field
- 46. Geospatial Field Index frompymongo import GEOSPHERE import geojson ! ! p = geojson.Point( [-73.9858603477478, 40.75929362758241]) ! coll.insert( {'point', p) ! coll.ensure_index( [( 'point', GEOSPHERE )]) index type
- 47.
- 48. Friends • mongoengine • http://mongoengine.org/ •Motor • http://motor.readthedocs.org/en/stable/ • async driver • Tornado • Greenlets • ming • http://sourceforge.net/projects/merciless/
- 49.
- 50. Recap • MongoDB isAwesome • Specially to work with Python • pymongo • super well supported • fully in sync with MongoDB server
- 51. MongoDB 3.0 ishere!
- 52.
- 53.